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@ Packet route scheduling in a packet cross connect switch system for periodic and statistical 
packets. 



© Routing of packets in a packet cross-connect 
switch is determined based on the particular type of 
packet, i.e., statistical or periodic, grade of service 
assigned to the packet, e.g., minimum delay, the 
actual queuing delay at output ports assigned to the 
particular packet destination and the status of the 
assigned output ports. Additionally, for periodic type 
packets the routing decision is also based on wheth- 
er an interval is reserved for transmission of periodic 
^packets at the assigned output ports. The routing 
^decision is also based under certain conditions on 
whether or not the packet has been previously 
^scheduled over an alternate route. The actual queu- 
^fing delay at the assigned output ports is compared 
^.to predetermined delay threshold values in determin- 
Qing the packet route and/or whether it should be 
^discarded. If the packet is a statistical hype and it 
Q was previously scheduled over an alternate route, it 
will be discarded, if it is not scheduled to be routed 



a. 
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via a primary one of the assigned output ports and 
the delay at a secondary, i.e. alternate, one of the 
assigned output ports is greater than a predeter- 



mined re-routing delay threshold value. In a specific 
embodiment, the delay threshold values are selected 
such that typically only statistical packets are sched- 
uled for an alternate route. Periodic packets are 
typically scheduled for an alternate route or dis- 
carded only for catastrophic failures. 
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PACKET ROUTE SCHEDULING IN A PACKET CROSS CONNECT SWITCH SYSTEM FOR PERIODIC AND 

STATISTICAL PACKETS 



Technical Field 

This invention relates to packet transmission 
systems and/or switching systems and, more par- 
ticularly, to the scheduling of packet transmission 
and/or switching routes. 



Background of the Invention 

In prior packet transmission systems and/or 
switching systems excessive performance degrada- 
tion results because of congestion at packet nodes. 
The congestion is typically caused by an inability 
to route efficiently the packets being transmitted 
from one transmission or switching route to another 
when necessary. In other prior known packet sys- 
tems, so-called alternate routing of packets is used 
in an attempt to mitigate the performance degrada- 
tion. 

One serious problem in such prior systems is 
that the alternate routing could cause certain types 
of packets to get out of sequence. This, of course, 
causes degraded performance, especially for pack- 
ets transporting so-called periodic, e. g., voice 
type, information. Another problem with the prior 
systems including alternate routing is that when 
there is a relatively high level of overall congestion 
in the system, a so-called "funeral effect", i.e., 
deadlock, resulted. The "funeral effect" is a con- 
dition in which packet throughput in the system 
becomes increasingly less as the load on the sys- 
tem increases. This undesirable result is caused by 
packets being retransmitted from their respective 
sources after the lapse of a predetermined interval 
without receiving an acknowledgment of reception 
from their destination. A primary cause for the 
"funeral effect" is that the same packets are al- 
ternate routed at a number of nodes in the system. 
Consequently, the individual packets which have 
been alternate routed never reach the destination 
assigned to them. Additionally, the alternate routed 
packets affect the delay of packets being sched- 
uled for transmission on primary assigned routes. 
This, in turn, results in more packets being sched- 
uled for transmission on their assigned alternate 
route, which further contributes to decreased 
"good" throughput in the system. 



Summary of the Invention 

Problems related to the routing of packets in 
prior systems are mitigated, in accordance with an 



aspect of the invention, by controllabiy determining 
the packet route based on the particular type of 
packet and the actual amount of delay at output 
ports assigned to the packet destination. 
5 To this end, each packet includes a transport 

word, i.e., header, having a plurality, of fields includ- 
ing at least a destination field and a so-called 
packet type field. The packet destination is as- 
signed predetermined at least primary and secon- 
io dary transmission routes which, in turn, are as- 
signed at least primary and secondary output ports, 
respectively, in a packet cross-connect switch. The 
packet type field includes indicators denoting at 
least the type of packet, i.e., whether periodic or 
75 statistical, the grade oi service assigned to the 
packet, for example, minimum delay, and the like. 

More specifically, whether periodic type pack- 
ets are transmitted over the assigned primary 
route, the assigned secondary route or discarded is 
20 dependent on the status of the primary and secon- 
dary output ports assigned to the particular packet 
destination, the actual delay at the primary and 
secondary output ports, an interval reserved for 
transmission of periodic packets at the primary and 
25 secondary output ports, a predetermined grade of 
service assigned to the packet and under certain 
conditions whether the particular periodic packet 
has been previously alternate routed. 

Similarly, whether statistical type packets are 
transmitted over the assigned primary route, the 
assigned secondary route or discarded is depen- 
dent on the status of the primary and secondary 
output ports assigned to the particular packet des- 
tination, the actual delay at the primary and secon- 
dary output ports, a predetermined grade of ser- 
vice assigned to the packet and under certain 
conditions whether the particular statistical packet 
has been previously alternate routed. 

In operation, a packet routing and/or discarding 
40 decision is made based, in part, on the status of 
the primary and secondary output ports assigned 
to the packet destination, the grade of service 
assigned to the packet and the actual delay at the 
output ports as compared to predetermined delay 
45 threshold values. Additionally, for periodic type 
packets, whether there is an interval reserved for 
transmission of periodic packets at the output ports 
is also employed in making the routing and/or 
discarding decision. Whether or not the particular 
so packet has been previously alternate routed is also 
employed under certain conditions in making the 
routing and/or discarding decision. If a statistical 
packet has been previously alternate routed it is 
discarded, if it is not being scheduled to be routed 
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via the primary output port and if the delay at the 
secondary output port is greater than a predeter- 
mined re-routing delay threshold value. 

In a specific embodiment of the invention, the 
delay threshold values are selected such that typi- 
cally only statistical packets are alternate routed. 
Accurate delay information is obtained from output 
ports of the cross-connect switch by employing a 
unique multi-queue bandwidth reservation arrange- 
ment for both the periodic packets and statistical 
packets. 

In accordance with another aspect of the inven- 
tion, indirect addressing is employed to schedule 
the routing of so-called logically addressed packets 
being received to appropriate output ports in the 
cross-connect The use of indirect addressing al- 
lows the packets to be routed to the appropriate 
output ports without knowledge of the particular 
output assignments at the source of the packet. 

The technical advantage of this invention is that 
we can achieve the goal of having a minimum 
delay variation for periodic packets while still pro- 
viding accurate scheduling for transmission of the 
statistical packets and minimizing the possibility of 
the so-called "funeral effect" from occurring. More- 
over, a single scheduler is advantageously em- 
ployed to make global routing decisions for a rela- 
tively large number of ports and approaches being 
a so-called "ideal" scheduler. 



Brief Description of the Drawing 

In the Drawing: 

FIG. 1 shows details, in simplified block dia- 
gram form, of a packet network node including 
aspects of the invention; 

FIG. 2 depicts a packet format, illustrating an 
aspect of the invention; 

FIG. 3 graphically illustrates a packet trans- 
port word, i.e., header, useful in describing an 
aspect of the invention; 

FIG. 4 depicts a packet transport word in- 
cluding aspects of the invention; 

FIG. 5 shows details, in simplified block dia- 
gram form, of input ports 104 employed in the 
packet cross-connect 1 03 of FIG. 1 ; 

FIG. 6 depicts a flow chart illustrating oper- 
ations performed in control 504 in controlling input 
port 104 of FIG. 5; 

FIG. 7 shows details, in simplified block dia- 
gram form, of output ports 110 employed in packet 
cross-connect 103 of FIG. 1; 

FIG. 8 depicts a sequence of timing dia- 
grams useful in describing the operation of packet 
cross-connect 103 of FIG. 1 and output ports 110 
of FIG. 7; 

FIG. 9 shows another sequence of timing 



diagrams also useful in describing the operation of 
packet cross-connect 103 of FIG. 1 and output 
ports 110 of FIG. 7; 

FIG. 10 depicts details, in simplified block 

5 diagram form, of reservation factor calculator 716 
used in output ports 110 shown in FIG. 7; 

FIGs. 11, 12, 13, 14 and 15 when connected 
A-A, B-B, C-C, D-D, E-E, F-F, G-G, H-H, l-l, J-J, K- 
K and L-L form a flow diagram illustrating oper- 

70 ations performed by scheduler 113 in packet cross- 
connect 103 of FIG. 1; and 

FIG. 16 shows a packet network arrange- 
ment in which packet network node 100 including 
aspects of the inventions may be advantageously 

75 employed. 



Detailed Description 

20 FIG. 1 shows details, in simplified block dia- 

gram form, of packet network node 100 for inter- 
connecting a plurality of incoming ports to a plural- 
ity of outgoing ports. Such packet network nodes 
may be advantageously employed in a network as 

25 shown in FIG. 16 and described below. Accord- 
ingly, signals from a plurality of sources are sup- 
plied via terminals 101-1 through 101-<X + Y) to 
packet network node 100. The sources may be. for 
example, broadband packet transmission facilities, 

30 digital data, RS232. DSO, DS1, DS3, other digital 
signals, other packet signals, e.g., LAPD (Link Ac- 
cess Protocol D channel), broadband packets of a 
type similar to those disclosed herein or the like. 
These signals may be analog or digital at- any 

35 desired rate. For example, the incoming signal bit 
rates could be the 64Kbit/sec DSO rate, the 1.544 
Mb/sec DS1 rate, or a 150 Mb/sec transmission 
rate including packet formatted information, or any 
higher or lower rate, as desired, 

40 If the incoming signal is being transmitted over 

a digital facility and includes packets in a broad- 
band packet format of a type employed in packet 
network node 100, it would be supplied to one of 
facility interfaces 102-1 through 102-X. Input facility 

45 interfaces 102, in this example, are employed to 
supply the packet information a byte at a time to 
packet cross-connect 103 and, therein, to a cor- 
responding one of input ports 104-1 through 104-X. 
Such facility interfaces are known in the art and, 

so typically, include a phase locked loop for recover- 
ing the incoming clock signal, a framer, a bipolar- 
to-unipolar converter if needed, an equalizer for the 
equalization of gain and/or delay distortion, perfor- 
mance monitoring apparatus and apparatus for re- 

55 formatting the incoming digital signal from the in- 
coming digital format into the broadband packet 
format used in cross-connect 103 which is supplied 
to a corresponding one of input ports 104-1 
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through 104-X a byte at a time. 

In this example, packet network node 100 also 
includes packetizers 105-1 through 105-Y. Each of 
packetizers 105-1 through 105-Y include an input 
local packet interface 106 and a parity unit 107. 
Operation of an exemplary one of packetizers 105 
in generating a packet transport word, i.e., header, 
and a packet format, in accordance with aspects of 
the invention, is described below. It should be 
noted, however, that depending on the type of 
signal source being interfaced the structure of the 
particular one of packetizers 105 may vary. How- 
ever, the broadband packet format being generated 
is the same for ali of packetizers 105. Such pac- 
ketizers may also be included in other remotely 
located equipments which supply signals to a 
packet network node 100 via a transmission facility 
and a corresponding input facility interface 102 or if 
desired directly to one of packetizers 105-1 
through 105-Y for reasons described below. It is 
noted that one of packetizers 105-1 through 105-Y 
is designated a control input. 

The broadband packet formatted incoming sig- 
nals are supplied from packetizers 105-1 through 
105-Y to input ports 104-(X + 1) through 104- 
(X + Y), respectively. A reference code word Xref is 
supplied from Xref unit 108 to each of packetizers 
105-1 through 105-Y, to each of input ports 104-1 
through 104-(X + Y) and to stuff port 109. Xref unit 
1 08 may include a register or other memory device 
for storing a desired reference code word. The 
reference code word Xref is unique to each net- 
work layer in the system hierarchy and provides 
so-called transmission transparency for all users. 
Additionally, private networks employing the same 
broadband packet format are each assigned a 
unique reference code word Xref which is used to 
delimit the private network packets and also pro- 
vides transparency in the system hierarchy. 

Each of input ports 104-1 through 1 04-(X + Y) is 
employed to delimit packets, to synchronize to the 
incoming broadband packet format and to store the 
packets which are to be obtained by appropriate 
ones of output ports 110-1 through 110-(X + Y), in 
accordance with aspects of the invention. To this 
end, each of input ports 104 interfaces on a syn- 
chronous basis with packet cross-connect 103 data 
bus (DBUS), address bus (ABUS) and transport 
bus (TBUS). These buses operate on a time di- 
vision multiplexed basis. Details of each of input 
ports 104 are shown in FIG. 5 and, are described 
below. 

Stuff port 109 generates so-called stuff packets 
which are transmitted when no other packets are 
present for transmission. Stuff port 108 generates 
the stuff packets in a manner substantially identical 
to that employed in packetizers 1 05 and described 
below. The stuff packets are stored in a buffer 
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memory for use as needed. Stuff packets are re- 
quested as needed by individual ones of output 
ports 110-1 through 110-(X + Y), as explained be- 
low. To this end. stuff port 109 interfaces with the 

5 packet cross-connect 103 address bus (ABUS) and 
data bus (DBUS). 

Each of output ports 110-1 through 110-(X + Y) 
is employed to supply packets obtained from input 
ports 104-1 through 104-(X + Y) and stuff port 109 

w to an appropriate one of output interlaces 111-1 
through. 111-X and output local packet interfaces 
112-1 through 112-Y. For example, if the packets 
are to be transmitted to a remote packet network 
node they will be supplied to one of output facility 

75 interfaces 111-1 through 111-X and. in turn, to 
output terminals 115-1 through 115-X, respectively. 
If the destination of a packet is the instant packet 
network node 100. it will be supplied to an appro- 
priate one of output local packet interfaces 112-1 

20 through 112-Y and, in turn, to output terminals 115- 
(X+1) through 115-(X + Y), respectively. As in the 
case of packetizers 105, output local packet inter- 
faces 112 may also require different structures 
depending on the type of equipment that is being 

25 interfaced. 

Output facility interfaces 111-1 through 111-X 
typically include apparatus for interfacing output 
ports 110-1 through 110-X, respectively, to pre- 
determined transmission facilities. To this end, 

30 each of output facility interfaces 1 1 1 include appro- 
priate apparatus for formatting the broadband pack- 
ets being transmitted into the particular signal for- 
mat of the corresponding transmission facility. 
Such output facility interfaces will be apparent to 

35 those skilled in the art. 

To this end. each of output ports 110-1 through 
110-{X + Y), in conjunction with scheduler 113, op- 
erates to schedule the transmission of the packets, 
in accordance with aspects of the invention. In 

40 order to realize these functions, each of output 
ports 110 interfaces on a synchronous basis with 
the packet cross-connect 103 data bus (DBUS), 
address bus (ABUS), scheduler bus (SBUS) and 
total quanta bus (TQBUS). Again, each of the 

45 cross-connect buses operates on a time division 
multiplexed basis. Details of each of output ports 
110 are shown in FIG. 7 and are described below. 

Scheduler 113, in conjunction with processor 
114, operates to control the routing of packets from 

so input ports 1 04 to output ports 110 and to statistics 
port 116 and to control output scheduling of the 
packets at output ports 110 in accordance with 
aspects of the invention. 

Processor 114 is supplied with information re- 

55 garding the status of output ports 110 and with 
delay difference (DD) values between primary and 
alternate routes assigned to the destination (DEST) 
for the particular packet being scheduled for trans- 
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mission. Additionally, statistics port 116 supplies 
information to processor 114 regarding the status 
of input ports 104. in turn, processor 114 supplies 
this information to scheduler 113. 

Operation of packet network node 100 and, 
therein, packet cross-connect 103 will become ap- 
parent to those skilled in the art from the following 
detailed description of the components thereof. It is 
noted, that the inputs to input ports 104 and the 
outputs from output ports 110 are asynchronous. 
However, the internal interfacing with input ports 
104 within packet cross-connect 103 is synchro- 
nous at a clock rate which is determined as a 
function of the number X + Y=N of input ports and 
the maximum transmission rate of the signals being 
supplied to packet network node 100. In this exam- 
ple, a particular time slot of cross-connect 103 
timing sequence i.e., polling cycle, is employed to 
write certain information in input ports 104, as will 
be explained below. A polling cycle is completed in 
an interval less than a packet word interval at the 
maximum incoming transmission rate. Thus, in this 
example, if the maximum incoming transmission 
rate is, for example, 150 Mb/sec, there are N=8 
ports and the word length is eight bytes, there will 
be 8+1=9 time slots per polling cycle and the 
synchronous clock rate in packet cross-connect 
1 03 is approximately 24Mb/sec. Each of input ports 
104-1 through 104-(X + Y) is identified by a time 
slot number in the synchronous polling cycle of 
scheduler 113. Specifically, the first time slot 
through the Nth time slot identify input ports 104-1 
through 104-(X + Y), respectively, to scheduler 113. 
During time slots N = X + Y, output ports 110-1 
through 110-(X + Y) have access to the memory 
units in input ports 104 and time slot N + 1 =0 is 
the time slot for writing input word data into units in 
input ports 104. 

Packet network node 1 00 may be employed in 
a number of applications, for example, as a switch- 
ing node, an access node or a so-called gateway 
node. However, it is important to note that the 
configuration of cross-connect 103 is independent 
of the network configuration it is employed in, 
whether the network configuration is a ring, star, 
mesh or the like. A switching node would typically 
include a plurality of N=X-1 input and N = X-1 
output facility interfaces 102 and 111, respectively, 
and at least one packetizer 105 and a correspond- 
ing output local packet interface 112. An access or 
gateway node would typically include Y = N-X input 
ports and Y = N-X output ports and at least one 
input facility interface 102 and at least one cor- 
responding output facility interface 111, i.e., X = 1 
and, preferably, includes Y = N-1 packetizers 105 
and Y = N-1 output local packet interfaces 112. For 
other applications, packet network node 100 may 
include a number of input, and output facility inter- 



faces (X) and a number of packetizers and output 
local packet interfaces (Y), where X = Y. However, 
any number of input facility interfaces and output 
facility interfaces, and packetizers and output local 

5 packet interfaces may be employed to meet sys- 
tem requirements in particular applications. It 
should be noted, however, for each type input 
interface there is a corresponding output interface. 
For example, if a digital signal is being received at 

70 this packet network node from a specific remote 
switching node via one of input facility interfaces 
102, a similar digital signal is being transmitted to 
the remote switching node via a corresponding one 
of output facility interfaces 111. Similarly, if a data 

75 signal is being received from a local area network 
at one of packetizers 105, a similar data signal is 
being supplied to the local area network by one of 
output local packet interfaces 112. That is to say, 
there is two-way communication between sources 

20 of signals being supplied to packet network node 
100. 



Packetizer 

25 

As indicated above, each of packetizers 105-1 
through 105-Y includes input local packet interface 
106 and parity unit 107, and is employed to gen- 
erate a packet format, in accordance with aspects 

30 of the invention, as shown in FIG. 2. To this end, 
input local packet interface 106 includes apparatus 
for interfacing the particular incoming signal in or- 
der to delimit it so that the broadband packet 
words may be formatted in accordance with the 

35 instant invention. Additionally, buffer storage is re- 
quired for the packet being formatted, a transport 
word generator, counters for counting the number 
of packet bytes and the number of packet words, 
apparatus for padding the last packet information 

40 word to build it out to the proper number of bytes 
and multiplex apparatus for combining packet in- 
formation words and the transport word to form the 
desired packet. The transport word generator can 
be a register or a read write (RAM) memory unit 

45 into which the desired information is inserted. Such 
apparatus is known in the art. 

Accordingly, shown in FIG. 2 is a packet format 
including transport word (header) 201 and a num- 
ber of information quanta, i.e., information words 

so 202-1 through 202-M. Details of the transport word 
are described below in conjunction with FIGs. 3 
and 4. The instant packet format including a num- 
ber M of information words 202. each having a 
relatively short fixed length, is particularly advanta- 

55 geous toward efficient packet transmission and/or 
switching. Prior arrangements used either totally 
variable length information fields delimited by flags, 
or a fixed length information field. The arrange- 
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ments using totally variable length information 
fields are undesirable because they use so-called 
bit level processing, and the arrangements using 
fixed length information fields are undesirable be- 
cause the length of the information field is either 
too long or too short. Use of a fixed length informa- 
tion field also requires that the entire information 
field be transmitted or switched even when only 
one byte of information is present. In the instant 
arrangement, only a number M of the relatively 
short information words are transmitted or switched 
as determined by the number of bytes of informa- 
tion to be included in the packet. Then, only the 
last information word in the packet may have to be 
padded to include bytes not used for information in 
order to build out the last word to its proper length. 
As shown in FIG. 2, information word 202-M, in this 
example, includes five bytes of user information 
and three bytes which have been padded and 
include so-called fill. In this example, not to be 
construed as limiting the scope of the invention, 
the number M of packet information words can be 
zero (0) to 255, each packet information word in- 
cludes eight bytes and each byte includes eight 
bits. Although the bytes of information are shown 
as being in parallel, it will be apparent that they 
could also be arranged in series. The packet format 
as shown in FIG. 2 is formed by packetizers 105 in 
a manner that will be apparent to those skilled in 
the art. 

Input local packet interface 106 also partially 
generates transport word 201 as shown in FIG. 3. 
In this example, transport word 201 also includes 
eight bytes with each byte having eight bits. Again, 
although the transport word bytes are shown as 
being in parallel they could equally be arranged in 
series. Thus, the transport word is the same size 
as each of the packet information words and will 
appear as such if supplied as an input to one of 
packetizers 105. BYTE (0) through BYTE (3) are 
employed for system address purposes and are 
designated the system address field. In this exam- 
ple, bit positions designated DEST (0) through 
DEST (11) form a destination field and are used to 
identify a packet network node address. As will be 
apparent to those skilled in the art, the bit positions 
designated VCID (0) through VCID (19) may be 
used to further identify the final destination of the 
corresponding packet and represent a so-called 
virtual circuit identification. In this example, bit po- 
sitions VCID (16) through VCID (19) are designated 
a destination extension (DEST EXT) field. If the 
destination of the packet is the instant packet net- 
work node, the DEST EXT field indicates which 
one of output ports 110-(X+1) through 110-(X + Y) 
is to be supplied with the packet. The remaining 
VCID bits are employed to identify the final des- 
tination of the packet and for billing purposes. 



BYTE (4) includes bit positions designated 
TYPE (0) through TYPE (4) and BKG (0) through 
BKG (2). Bit positions TYPE (0) through TYPE (4) 
indicate the class or grade of service assigned to 

5 the corresponding packet and is designated the 
type of packet field. Bit position TYPE (0) indicates 
if the packet is alternate routable. Thus, a logical 1 
in bit position TYPE (0) indicates that the packet is 
alternate routable, and a logical 0 indicates it is not. 

10 In this example, normally only statistical packets 
are alternate routable. The only instances that a 
periodic packet would be alternate routed are if 
there was a failure in the primary route assigned to 
the destination for the packet or for some reason 

75 the packet was assigned a class of service requir- 
ing a minimum delay. Bit position TYPE (1) in- 
dicates the type of packet, i.e., statistical or peri- 
odic. That is, if the information words of the packet 
include bursty information, the packet is designated 

20 a statistical packet, and if the information words of 
the packet, include circuit type information, e.g., 
PCM encoded voice or the like, the packet is 
designated a periodic packet. Thus, a logical 1 in 
bit position TYPE (1) indicates a periodic packet, 

25 while a logical 0 indicates a statistical packet. Bit 
positions TYPE (2) and TYPE (3) are employed to 
select the values of thresholds employed in sched- 
uler 113, as described below. Bit position TYPE (4) 
indicates whether or not the packet is assigned a 

30 minimum delay class of service. Bit positions BKG 
(0) through BKG (2) are designated the breakage 
field and indicate the number of bytes in the last 
information word M of the packet that do not in- 
clude user information being transmitted and, 

35 hence, have been padded. It will be apparent that 
bit positions BKG (0) through BKG (2) could equal- 
ly be used to indicate the number of bytes includ- 
ing user information in the last information word. 
BYTE (5) includes bit positions SIZE (0) 

40 through SIZE (7) which are designated the SIZE 
field. Bits are placed in the SIZE field which in- 
dicate the number M of information words, i.e., 
quanta, in the corresponding packet. That is, bits 
representative of the packet length indicator are 

45 placed in the SIZE field. Again, in this example, M 
can be zero(0) to 255. 

BYTE (6) includes six vacant bit positions for a 
plurality of first parity check bits which form a first 
prescribed parity check pattern to be inserted by 

so parity unit 107 and bit positions SGZ and EXG. 
The six vacant bit positions are designated the first 
parity check field. Bit position SGZ, in this exam- 
" pie, indicates whether or not the packet includes a 
number of information words greater than or equal 

55 to zero (0). If the packet length is not. greater than 
zero, the packet length indicator bits are not need- 
ed and information can be transmitted in the SIZE 
field of BYTE (5) of the transport word. Thus, if 
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only one (1) byte of information is to be transmit- 
ted, SGZ is set to a logical 0 and the byte of 
information is inserted into the bit positions of the 
SIZE field in BYTE (5), in place of the packet 
length indicator bits. BYTE (5) is available because 
there is no need in such a packet for a packet 
length indicator because one packet word is as- 
sumed- It will be apparent to those skilled in the art 
that this technique can be extended to transmit two 
or even three bytes of information in the transport 
word and, therefore, eliminate the need to transmit 
additional - information words in this situation. It 
should also be noted that additional ones of the 
transport word fields may be usable to transmit 
user information. The use of the additional fields in 
the transport word will also increase transmission 
efficiency by minimizing the number of information 
words that need to be transmitted. One example, 
where additional transport word fields may be used 
to transport information is a control packet. Bit 
position EXC in BYTE (6) is used to indicate wheth- 
er or not the packet is a control packet 

BYTE (7) includes eight vacant bit positions for 
a plurality of second parity check bits forming a 
second prescribed parity check pattern to be in- 
serted by parity unit 107. The eight- vacant bit 
positions of BYTE (7) are designated the second 
parity check field. 

Input local packet interface 106 supplies the 
packet information to parity unit 1 07 on a byte-wise 
basis. Also supplied to parity unit 107 are an EN- 
ABLE signal and a start of packet (SOP) signal. 
The ENABLE signal indicates a valid byte of in- 
formation is available and the SOP signal indicates 
the beginning of a packet and, hence, the begin- 
ning of a transport word. 

Parity unit 107, in each of packetizers 105 
generates prescribed parity check bits which form 
a plurality of prescribed parity check patterns that 
are inserted into the vacant bit positions of BYTES 
(6) and (7) of the transport word, as indicated in 
FIG. 4. FIG. 4 also indicates that reference cocie 
word Xref, shown in dashed outline, is employed in 
generating the prescribed parity check bits which 
form, in this example, the plurality of prescribed 
parity checks. It will be apparent to those skilled in 
the art, that use of reference code word Xref is not 
necessary in practicing certain aspects of the in- 
vention. Indeed, either EVEN or ODD parity can be 
used in generating the prescribed parity check bits. 
Use of Xref and the number of bits included in Xref 
is determined by the number of network layers 
including private networks in a particular system. 
Additionally, it will also be apparent that the num- 
ber of prescribed parity checks and the bit patterns 
used in computing the parity check bits used in 
practicing the invention is dependent on the degree 
of robustness desired in the system. In this em- 



bodiment of the invention, two prescribed parity 
checks including 14 parity check bits are used to 
obtain a desired level of robustness. That is to say, 
each bit from the bit positions of BYTE (0) through 

5 BYTE (6) of the transport word is used in comput- 
ing at least two different parity check bits. 

Accordingly, parity unit 107 is supplied with 
start of packet signal (SOP), an ENABLE signal and 
packet information BYTE from input local packet 

70 interface 106. The SOP signal indicates the begin- 
ning of the corresponding packet and, hence, the 
beginning of the transport word. The ENABLE sig- 
nal indicates that a valid BYTE of packet informa- 
tion is available. In this example, a first prescribed 

15 parity check is generated, in well known fashion, 
over the bits in each of vertical columns, i. e., 
groups of bit positions, of BYTE (0) through BYTE 
(5), and can be either EVEN parity or ODD parity, 
as desired or as indicated below when using refer- 

20 ence code word Kref. That is to say, a separate 
parity check bit is generated over each of the 
vertical columns of BYTE (0) through BYTE (5). 
The first prescribed parity check bits which are 
generated for BYTE (0) through BYTE (5) are 

25 PBYT (0) through PBYT (5), respectively, and form 
the first prescribed parity pattern which is inserted 
into the first parity check field in BYTE (6) of the 
transport word, as shown in FIG. 4. It will be 
apparent that the parity for generating the individ- 

30 ual parity check bits need not be restricted to a 
byte but can be computed from bits in any number 
of bit positions in one or more bytes, or groups of 
bit positions. For example, parity can be computed 
from bits in specific ones of the functional fields of 

35 the transport word. In this example, a second pre- 
scribed parity check is generated, in well known 
fashion, over predetermined ones of the bits in 
each of the horizontal rows designated BIT (0) 
through BIT (7), i. e., from predetermined similar bit 

40 positions in each group of bit positions. The parity 
generated for each row can also be either EVEN 
parity or ODD parity, as desired. It is noted that, in 
this example, a parity check bit is generated for 
each of horizontal rows BIT (0) through BIT (7) 

45 including the bits in BYTE (0) through BYTE (6). 
Thus, parity check bits in bit positions PBYT (0) 
through PBYT (5) are included in the computation 
of parity check bits forming the second prescribed 
parity check. Again, this increases the robustness 

so of the system so that the likelihood of a packet 
information word emulating a transport word is 
greatly reduced. Thus, a separate parity check bit 
is generated for each of horizontal rows BIT. (0) 
through BIT (7). The second prescribed parity 

55 check bits which are generated for horizontal rows 
BIT (0) through BIT (7) are PBIT (0) through PBIT 
(7), respectively, and form the second prescribed 
parity check pattern which is inserted into the sec- 
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ond parity check field in BYTE (7) of the transport 
word, as shown in FIG. 4. It is noted, however, that 
the parity check bits may be computed from bits in 
any desired pattern of bit positions in the transport 
word. Indeed, any desired number of parity checks 
may be employed in practicing aspects of the 
invention to realize any desired level of robustness. 

As indicated above, the use of reference code 
word Xref guarantees transparency for a large 
number of user networks. Additionally, the use of 
reference code word Xref causes the probability 
that a private network transport word can emulate a 
public system transport word to be zero. In this 
example, reference code word Xref includes bits 
Xref (0) through Xref (1 1 ). Xref (0) through Xref (7) 
are associated with horizontal roils of bits des- 
ignated BIT (0) through BIT (7), respectively, and 
Kief (8) through Xref (11) are associated with BYTE 
(0) through BYTE (3), respectively. It should be 
noted that the number of bit positions in Xref can 
be increased or decreased, respectively as de- 
sired. Additionally, the bits of Xref can be applied 
to any desired bit positions in the transport word. 
For example, individual ones of the bits of Xref can 
be associated with a specific functional field of the 
transport word. The parity check bits generated 
over the bits of BYTE (4) and BYTE (5) can be 
either EVEN or ODD, as desired. Logical signals in 
the bit positions of Xref designate the type of parity 
generated over the associated roll of bits and the 
associated BYTES. In this example, a logical 1 in a 
bit position of Xref designates EVEN parity, while a 
logical 0 designates ODD parity. Thus, Xref can be 
set to any desired combination of logical Vs and 
logical 0's. However, it should be noted that Xref is 
the same for a predetermined network or commu- 
nity of nodes. Again, the unique prescribed parity 
checks are used in conjunction with the packet 
length indicator, in accordance with aspects of the 
invention, to delimit the packets and effect packet 
synchronization. Moreover, the use of the unique 
prescribed parity checks provides verification of the 
transport word fields. Additionally, as described 
below, a unique reference code word Xref can be 
assigned to a specific transport user to provide a 
unique identity for its packets and to assure trans- 
parency of its packets in the system hierarchy. 

Again, each of packetizers 105 generates the 
packet format as shown in FIG. 2, in a manner 
which will be apparent to those skilled in the art, by 
accumulating the number M of information words 
202 in the packet and appending the transport 
word 201 to them. To this end, each of input local 
packet interfaces 106 stores the information words 
and inserts the appropriate information concerning 
the packet into the fields of the transport word as 
shown in FIG. 3. This information includes the 
address information to be placed in the address 



field including the network destination in bit posi- 
tion DEST (0) through DEST (11) (FIG. 3). and the 
destination extension (DEST EXT) in bit positions 
VCID (16) through VCID (19) and the final destina- 

5 tion in the remaining VCID bits. The type informa- 
tion is inserted into bit positions TYPE (0) through 
TYPE (4). The type of packet whether statistical or 
periodic is usually provided at call set up or other- 
wise known by the originating packetizer. The 

10 breakage information is inserted into bit positions 
BKG (0) through BKG (2) and is readily obtained 
by knowing the number of bytes of information in 
the packet being formatted or the number of bytes 
of information in the last information word of the 

J5 packet. Similarly, the packet size information is 
inserted into bit positions SIZE (0) and SIZE (7). 
This is readily obtained by knowing the number of 
information words being stored for the packet being 
formatted. The packet size greater than zero in- 

20 formation is inserted in bit position SGZ. If the 
packet information is in only one byte, a logical 
zero is inserted in the SGZ field and the byte of 
information is inserted in the transport word SIZE 
field. Again, this information is readily obtained 

25 from the number of bytes of information being 
stored for the packet being formatted. Finally, in- 
formation indicating whether or not the packet is a 
special packet is inserted in bit position EXC. 

It should be noted that, when there is no in- 

30 formation being stored to be formatted into either 
an information packet or a control packet, input 
local interface 106 in conjunction with parity unit 
107 generates a so-called stuff packet. Stuff pack- 
ets are generated in the same manner as the 

35 information and control packets described above. 
The differences being that the number of informa- 
tion words in the stuff packet is zero as indicated 
by the size field and SGZ. and the destination field 
indicates to scheduler 113 that the stuff packet 

40 should be scheduled for statistics gathering and be 
directed to statistics port 116. The stuff packet is 
comprised of just a transport word. 

The packets, whether information, control or 
stuff are supplied to parity unit 107 on a byte-wise 

45 basis along with an ENABLE signal and a start of 
packet (SOP) signal. Parity unit 107 in response to 
the ENABLE and SOP signals operates to generate 
the first and second parity checks, as described 
above. The generated first parity check bits PBYTE 

so (0) through PBYTE (5) are inserted into the first 
parity check field and the generated second parity 
check bits PBIT (0) through PBIT (7) are inserted 
into the second parity check field. The first and 
second parity checks are employed in conjunction 

55 with the packet length indicator, in accordance with 
an aspect of the invention, to delimit the packets 
and synchronize the system. As indicated above, 
parity unit 107 is also supplied with reference code 
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word Xref which is employed, in accordance with 
an aspect of the invention, to generate the first and 
second parity checks which provide a desired level 
of robustness to the synchronization process. Addi- 
tionally, the use of reference code word Xref pro- 
vides a unique identity for a network and also 
assures that the network user's packets are trans- 
parent in the public system hierarchy. The resulting 
transport word for the formatted packet is shown 
sin FIG. 4. 

A specific transport user can employ a pac- 
ketizer essentially identical to packetizer 105 to 
generate packets or employ packet network nodes 
essentially identical to packet network node 100 in 
a private network. Then, a unique reference code 
word Xref is assigned to the specific transport user 
to provide a unique network identity. The packets 
generated with the unique reference code word are 
assured to be transparent in the public system 
hierarchy. The broadband packets generated in the 
private network are identical to the broadband 
packets described above. Consequently, the pri- 
vate network packets including their transport 
words appear as information to packetizer 105 in 
packet network node 100 and, therefore, are trans- 
parent. Packet network node 1 00 simply appends a 
transport word to the supplied information to form 
packets. When the private network packets reach 
the transport user's private network, the public net- 
work transport word is removed and its unique 
reference code word Xref is recognized and the 
private network packets are transmitted therein. 
The packets are supplied on a byte-wise basis 
from packetizers 105-1 through 105-Y to input 
ports 104-(X + 1) through 104~(X + Y), respectively. 
Also supplied from packetizers 105-1 through 105- 
Y are corresponding ENABLE IN signals. The EN- 
ABLE IN signal indicates to the corresponding in- 
put port that a valid byte of packet information is 
available to be supplied. 

It is important to note that the use of the first 
and second parity checks, in this example, is pow- 
erful enough to verify the data fields in the trans- 
port word. This eliminates the need of an additional 
separate check for the transport word fields as was 
required in prior arrangements. Additionally, al- 
though so-called group processing is advanta- 
geously employed in practicing aspects of the in- 
vention, it will be apparent that other types of 
processing may be employed. 

INPUT PORT 

FIG. 5 shows details, in simplified block dia- 
gram form, of input ports 104. Accordingly, shift 
bytes unit 501 is supplied an ENABLE IN signal, 
the reference code word Kief and packet bytes in 



parallel via BYTE IN. ENABLE IN is at an incoming 
clock rate and indicates that a valid packet byte is 
available for this input port. ENABLE IN is also 
supplied to byte counter 502. Shift bytes unit 501 

s includes a word wide shift register, parity gener- 
ators and a comparator (not shown). Ih this exam- 
ple, a word includes eight (8) bytes in series and 
each byte includes eight (8) parallel bits. 

Shift bytes unit 501 operates initially to gen- 

io erate the first and second parity checks, as de- 
scribed above, in relationship to parity unit 107 
(FIG.1) in well known fashion, over each eight 
bytes supplied thereto on a byte-by-byte basis. If a 
match is obtained between the generated first and 

is second prescribed parity checks, and the expected 
first and second parity patterns in the predeter- 
mined fields of the packet word, i.e., PBYT(0) 
through PBYT{5) and PBIT(0) through PBIT(7) f a 
Tok = 1 is generated. Outputs from shift bytes unit 

20 501 are the packet word (WORD), the packet 
length field (SIZE), the packet length greater than 
zero field (SGZ), and a transport word candidate 
indicator (Tok). Shift bytes unit 501 supplies as 
outputs SIZE, SGZ and Tok which, in turn, are 

25 supplied to control 506. The packet WORD is sup- 
plied to word latch 503 where it is stored until write 
time slot 0 occurs in the polling cycle of packet 
cross connect 103, at which time RAM 504 is 
enabled to write the WORD. Appropriate fields of 

30 the packet WORD are also written into scheduler 
data store 505 if it is a transport word candidate as 
indicated by Tword = 1 . The packet WORD is writ- 
ten into a memory location in RAM 504 identified 
by an address generated by address generator 

35 509. RAM address generator 509 is responsive to a 
word complete (WC) signal from byte counter 502 
to advance a write address counter during the write 
time slot. RAM address generator 509 is also oper- 
ative to pass address signals from address bus 

40 ABUS to read a packet WORD from RAM 504 
which is supplied to databus DBUS and, conse- 
quently, to the one of output ports 110 (FIG.1) 
requesting the corresponding WORD. It is noted 
that anyone of output ports 110 can read a word 

45 from any given input port 104 during a polling 
cycle. In this example, RAM 504' has the capability 
of storing 4K words. 

Byte counter 502 is responsive to ENABLE IN 
for counting the number of packet bytes supplied 

so to input port 104. A word complete output (WC) 
from byte counter 502 indicates that a packet word, 
in this example, 8 bytes, is complete and is sup- 
plied'to word counter 507, word latch 503, sched- 
uler data store 505, status latch 508 and RAM 

55 address generator 509. 

In response to the word complete (WC) signal, 
word latch 503 latches the WORD from shift bytes 
unit 503; status latch 508 latches the WORD 
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COUNT from word counter 507, Tword from control 
506 and IpkTok from control 506; RAM address 
generator 509 is enabled to be advanced by one 
address; and scheduler data store 505 is enabled 
to input data. It is noted that a WC signal is also 
generated when byte counter 502 is reset. 

Word counter 507 is responsive to the WC 
output from byte counter 502 to count the number 
of packet words supplied to input port 104. The 
count of packet words (WORD COUNT) is supplied 
to status latch 508 and to control 506. 

Scheduler interface 510 interfaces input port 
104 to TBUS. 

Control 506 is responsive to the supplied SIZE 
field, SGZ field, Tok and WORD COUNT for con- 
trolling input port 104 to synchronize on the incom- 
ing packets. To this end, control 506 generates a 
signal Tword, which indicates whether or not the 
packet word is a possible transport word candidate 
and a signal IpkTok which indicates whether or not 
the last packet transport word was valid, i.e., ok. 
Tword and IpkTok are supplied to status latch 508. 

Operation of control 506 in obtaining frame 
synchronization of input port 104 for incoming 
packets can be explained by referring to the flow 
chart shown in FIG. 6. Accordingly, the control 
routine is entered via enter step 601. Thereafter, 
operational block 602 initializes byte counter 502 
and word counter 507 by resetting them and the 
stored packet SIZE is set to zero (0) packet words, 
i.e., M = 0. Input port 104 is defined to be in an 
OUT-OF-FRAME mode. Operational block 603 in- 
dicates that packet byte has been supplied to shift 
bytes unit 501. As indicated above, shift bytes unit 
501 generates the predetermined first and second 
parity check bits and compares them to the first 
and second parity check bits in the predetermined 
fields of the packet word, namely, PBYTE(O) 
through PBYTE(s) in BYTE (6) and PBIT(0) through 
PBIT(7) in BYTE (7) (FIG.4). If a match is obtained 
a Tok = 1 is generated. Otherwise, a Tok = 0 is 
generated. Conditional branch point 604 tests to 
determine whether or not the WORD COUNT in 
word counter 507 is equal to the number of packet 
words indicated by SIZE plus one (1), i.e., M + 1. In 
the initial pass of the process, step 604 yields a 
YES result after the first word has been supplied to 
shift bytes unit 501(FIG.5). On subsequent passes, 
the packet length indicator value M is obtained 
from the expected SIZE field and the SGZ field in 
the packet word, namely, BYTE (5) and the SGZ 
bit position in BYTE (6). If the test result in step 

604 is NO, conditional branch point 605 tests to 
determine if Tok = 1 . If the test result in step 605 is 
NO. control is returned to operational block 603. 
Thereafter, steps 603. 604 and 605 are iterated 
until either step 604 yields a YES result or step 

605 yields a YES result. If step 604 yields a YES 



result, conditional branch point 606 tests to deter- 
mine if Tok = 1. If the test in step 606 is NO, 
operational block . 607 sets Tword = 1 , and 
IpkTok = 0. resets byte counter 502 and word coun- 

5 ter 507, and causes the expected number of in- 
formation words (M) in the packet from the SIZE 
field to be stored. Signal IpkTok indicates whether 
or not the last packet transport word candidate is 
valid or not. Accordingly, IpkTok = 0 indicates that 

io the last packet transport word candidate is not valid 
and IpkTok = 1 indicates that it is valid. Resetting of 
byte counter 502 generates a WC signal. Con- 
sequently, the current WORD from shift bytes unit 
501 is latched in word latch 503; the WORD 

75 COUNT from word counter 507, Tword from control 

506 and IpkTok from control 506 are latched in 
status latch 508; RAM address generator 509 is 
enabled to be advanced an address; and scheduler 
data store 505 is enabled to store data. Upon write 

20 time slot 0 occurring in the synchronous polling 
cycle of packet cross connect 103, the address in 
RAM address generator 509 is advanced and the 
packet WORD from word latch 503 is written into 
the memory location of RAM 504 identified by 

25 RAM address generator 509. Similarly, upon the 
write time slot occurring in the polling cycle of 
packet cross-connect 103 and Tword = 1 from sta- 
tus latch 508, the DEST, DEST EXT, and TYPE 
fields from the packet WORD stored in word latch 

30 503 are written into scheduler data store 505. Addi- 
tionally, the corresponding address designating the 
packet starting address (SAD) from RAM address 
generator 509 for the packet word is also written 
into scheduler data store 505. Thereafter, appro- 

35 priate ones of steps 603 through 607 are iterated 
until either step 605 or step 606 yields a YES 
result, either of these YES results indicates that a 
possible transport word candidate has been iden- 
tified and a so-called ALMOST IN-FRAME mode of 

40 operation is entered. To this end, operational block 
608 sets Tword = 1 and IpkTok = 0, resets byte 
counter 502 and word counter 507. and causes the 
number of information words M from the SIZE field 
to be stored. Again, the resetting of counter 502 

45 causes generation of a WC signal which, in turn, 
causes the actions to occur as set forth above in 
step 607. Operational block 608 indicates that an- 
other packet byte has been suppled to shift bytes 
unit 501. Then, conditional branch point 610 tests 

so to determine if the WORD COUNT in word counter 

507 equals SIZE + 1 . SIZE + 1 is the total length of 
the packet and points to the expected next packet 
transport word. If the test result in step 610 is NO. 
conditional branch point 611 tests to determine if 

55 Tok = 1. If the test result in step 611 is NO. the 
current packet WORD in shift bytes unit 501 is not 
a valid transport word candidate and steps 609 
through 611 are repeated until either step 610 or 
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step 611 yields a YES result If step 610 yields a 
YES result, conditional branch point 612 tests to 
determine if Tok = 1. If the test result in step 612 is 
NO, the packet WORD presently in word latch 503 
is not a valid transport word candidate. Control is 
returned to step 607 and appropriate ones of steps 
603 through 612 are iterated. If step 611 yields a 
YES result, the current packet WORD in word latch 
503 is not a valid transport word and steps 608 
through 611 are iterated until step 610 yields a 
YES result and step 612 is reached. A NO result in 
step 612 again indicates that the present packet 
WORD being pointed to by the previous packet 
length indicator is not a valid transport word and 
the reframing process is reinitiated by returning 
control to step 607. When step 612 yields a YES 
* result, the WORD latched in word latch 503 is a 
valid transport word and input port 104 is in syn- 
chronism with the incoming broadband packets. An 
IN-FRAME mode of operation has been entered. 

To summarize, steps 603 through 607 operate 
on the incoming packet on a byte-by-byte basis to 
identify a first transport word candidate. Then steps 
608 through 612 operate on the incoming packet 
also on a byte-by-byte basis to identify a subse- 
quent transport word candidate pointed to by the 
packet length indicator from the previous transport 
word candidate. Upon detection of the subsequent 
transport word candidate pointed to by the packet 
length indicator from the previous transport word 
candidate, the previous transport word candidate is 
identified as a valid transport word, in accordance 
with an aspect of the invention. 

Once a valid transport word has been iden- 
tified, operation of input port 104 enters an IN- 
FRAME mode. In the IN : FRAME mode, testing for 
transport word candidates, in this example, is done 
on a word wise basis. To this end, operational 
block 613 sets Tword = 1 and lpkTok = 1, resets 
byte counter 502 and word counter 507 and causes 
the number of information words in the packet from 
the SIZE field to be stored. This indicates that a 
GOOD transport word and, hence, a GOOD packet 
has been identified. That is to say, the last packet 
. received has been identified as a GOOD packet. 
Thereafter, operational block 614 indicates that a 
packet word has been supplied to shift bytes unit 
501. Then; conditional branch point 615 tests to 
determine if the WORD COUNT in word counter 
507 equals SIZE + 1. If the test result in step 615 is 
NO, steps 613 and 614 are repeated until a YES 
result in step 615 is obtained. Thereafter, con- 
ditional branch point 61 6 tests if Tok = 1 . If the test 
result in step 616 is YES, another GOOD packet 
has again been identified. Again, the WORD 
COUNT from word counter 507, and Tword and 
IpkTok signals from control 506 are written into 
status latch 508 in response to a word complete 



(WC) signal. In turn, the stored WORD COUNT and 
IpkTok signal are written into scheduler interface 
510 during the write time slot of the polling cycle of 
cross-connect 103. When IpkTok =1 the packet 

s transport data stored in scheduler data store 505 
for the last previous packet and IpkTok are sup- 
plied via scheduler interface 510 to cross connect 
103 transport bus TBUS for use by scheduler 113. 
That is, the packet transport information fields 

io DEST, DEST EXT, WORD COUNT and TYPE, the 
packet starting address (SAD) and the last packet 
status IpkTok are supplied to TBUS. The packet 
source (SCR), i.e., input port, is known to scheduler 
113 by the time slot in the polling cycle during 

?s which the transport information was supplied to 
TBUS. If the test result in step 616 is NO, the 
operation of input port 104 re-enters the OUT-OF- 
FRAME mode, control is returned to step 607 and 
the reframing process is reinitiated. 

20 

STUFF PORT 

Stuff port 108 generates so-called stuff packets 
25 which are stored in buffer memory for use by 
output ports 110-1 through 110-(X + Y) when no 
other packets are available for transmission. The 
stuff packets each comprise only a transport word 
which is generated in identical manner as de- 
30 scribed above regarding packetizers 105. The 
DEST field, however, includes a predetermined 
destination which indicates that the packet is a stuff 
packet and eventually will be used to determine 
facility activity. To this end, stuff port 108 inter- 
35 faces with address bus ABUS and data bus DBUS. 



OUTPUT PORT 

40 FIG. 7 shows details, in simplified block dia- 

gram form, of each of output ports 110. As in- 
dicated above, each of output ports 110 interfaces 
with cross-connect 103 address bus ABUS, sched- 
uler bus SBUS, data bus DBUS and total quanta 

45 bus TQBUS. As explained below, scheduler 113 
supplies packet output information via SBUS con- 
cerning packets to be transmitted by output ports 
110. This information includes the output port iden- 
tity, the input port identity (SRC), the starting ad- 

50 dress (SAD) of the packet being stored in the 
corresponding input port, WORD COUNT (total 
length) of the packet and the TYPE of packet, i.e., 
periodic or statistical. Output port 110 operates on 
this information, in accordance with aspects of the 

55 invention, to schedule transmitting of statistical 
packets and to reserve intervals for transmitting 
periodic packets. 

The packet output information is obtained from 



11 



21 



EP 0 404 443 A2 



22 



SBUS at the appropriate one of output ports 110 
by queue controller (QCON) 701. QCON 701 deter- 
mines from TYPE whether the packet is a periodic 
packet or a statistical packet. If it is a periodic 
packet, the input port identity (SRC), packet start- 
ing address (SAD) and total length, i.e.. WORD 
COUNT (M + t) in packet word intervals, of the 
packet are stored in periodic queue 702, REAL 
QSUM counter 703 is incremented by the WORD 
COUNT and RESERVED QSUM counter 704 is 
decremented by the WORD COUNT. It is noted 
that the value RESQSUM in RESERVE QSUM 
counter 704 cannot be less than zero (0). RESQ- 
SUM is supplied to adder 709 and TQBUS. If the 
packet is statistical, the input port identification 
(SRC), packet starting address (SAD) and the 
WORD COUNT for the packet are stored in statisti- 
cal queue 705; REAL QSUM counter 703 is incre- 
mented by the WORD COUNT; and RESERVE 
QSUM counter 704 is incremented by a value 
representative of a reserved interval (Rl), namely, 
Rl = (k/1-k)(M + 1), of packet words. 

Reservation factor k, in this example, is repre- 
sentative of the percentage of periodic packets 
expected to be transmitted from a corresponding 
output port. The value of reservation factor k can 
be a predetermined fixed value, a value supplied 
by a processor based on call set-up or calculated 
dynamically by reservation factor calculator 716. 
Reservation factor calculator 716 is responsive to 
the word complete signal WC and the number of 
periodic, i.e., Type 1, packet words being transmit- 
ted by output port 110 during a predetermined 
interval to generate the value of reservation factor 
k. Details of reservation factor calculator 716 are 
shown in FIG. 10 and described below. 

Both periodic queue 702 and statistical queue 
705 are, in this example, first in first out (FIFO) 
registers and interface with next packet unit 706. 
REAL QSUM counter 703 is decremented by one 
packet word in response to a word complete (WC) 
signal from byte counter 707. This follows because 
a packet word has been transmitted. Time unit 708 
generates a refence time T, which is arbitrary time, 
e.g., now. Time unit 708 is also incremented by a 
packet word interval in response to the WC signal. 
Since in this packet network node, packets are 
continuous and contiguous in the byte intervals 
designated by ENABLE, this is a smooth process. 

Adder 709 combines the REAL QSUM and 
RESQSUM to obtain TQSUM, namely, 
TQSUM = REAL QSUM + RESQSUM, (1) 
where the individual values are in packet word 
intervals and TQSUM is representative of the queu- 
ing delay in the output port. In turn, TQSUM is 
supplied to adder 710 and TQBUS. Adder 710 is 
enabled in response to arriving statistical packets 
at statistical queue 705 to combine TQSUM and 



time T to obtain the scheduled time of service 
value STOS for each corresponding statistical 
packet, namely, 
STOS = TQSUM + T. (2) 

5 This operation will become more apparent from the 
discussion of FIGs. 8 and 9 below. 

The STOS values for the arriving statistical 
packets are stored in scheduled time of service 
(STOS) queue 71 1 which, in this example, is also a 

10 FIFO register. The next scheduled time of service 
(NSTOS) at the top of the FIFO in STOS queue 
711 is supplied to next packet unit 706. Also sup- 
plied to next packet unit is time T and a packet 
complete (PC) signal from word counter 712. Next 

75 packet unit 706 operates to supply the starting 
address (SAR) and the input port identity (SRC) of 
the packet to be transmitted to address counter 
713 and. the total packet length M+1 as indicated 
by WORD COUNT to word counter 712. If the next 

20 packet to be transmitted is a statistical packet, 
supplying of this information is delayed at least 
until the scheduled time of service (STOS) occurs 
or, thereafter, until transmission of a periodic or 
stuff packet has been completed. If there is no 

25 information regarding periodic packets to be trans- 
mitted in periodic queue 702 and the next sched- 
uled time of service (NSTOS) for a statistical pack- 
et has not occurred stuff packets are requested by 
supplying the address of a stuff packet in stuff port 

30 109 to address counter 713. Next packet unit 706 
supplies as an output a logical 1 STUFF signal 
when a stuff packet is being transmitted. The 
STUFF signal is supplied to a corresponding one of 
output local packet interfaces 112 (FIG. 1), to REAL 

35 QSUIVI counter 703 and RESERVE QSIfM counter 
704. It is noted that the STUFF signal is not re- 
quired to be supplied to output facility interfaces 
111. REAL QSUM counter 703 is responsive to the 
logical 1 STUFF signal to inhibit its decrement 

40 input (-) so that the REAL QSUM is not decremen- 
ted in response to a word complete signal WC. 
This follows because the REAL QSUM count was 
not incremented in response to the stuff packet 
request. The STUFF signal is also supplied to the 

45 decrement input of RESERVE QSUM counter 704 
and the RESQSUM count is decremented by one 
packet word in response to the logical 1 STUFF 
signal. Address counter 713 supplies the address 
of the requested packet word to address bus ABUS 

so and, in turn, the identified word in the correspond- 
ing one of input ports 104 RAM memory or stuff 
port 1 09 is read to data bus DBUS and supplied to 
word latch 714. Byte converter 715 supplies the 
packet words a byte at a time in response to 

55 ENABLE OUT from a corresponding output inter- 
face. ENABLE OUT is also supplied to byte coun- 
ter 707 which generates a word complete (WC) 
signal when the appropriate number of bytes have 



12 



23 



EP 0 404 443 A2 



24 



been transmitted. In this example, a packet word 
includes eight bytes in series and each byte in- 
cludes eight bits in parallel. The WC signal is also 
supplied to word counter 712, address counter 713, 
word latch 714, byte converter 715 and reservation 
factor calculator 716. Word counter 712 is respon- 
sive to WC and the total length of the packet, i. e., 
WORD COUNT, to generate a packet complete 
(PC) signal when the number of packet words 
transmitted equals WORD COUNT. Packet com- 
plete signal PC is supplied to next packet unit 706 
to initiate transmission of the next packet. Word 
counter 712 also supplies a first packet word signal 
to byte counter 707 which, in response thereto, 
generates a start of packet (SOP) signal. Address 
counter 713 is responsive to the WC signal to 
advance the address by one word and, hence, 
identify the memory ■ location in the appropriate 
input port RAM storing the next packet word to be 
supplied via DBUS to word latch 714. The STUFF 
and SOP signals are supplied to a corresponding 
one of output local packet interfaces 112-1 through 
112-Y. The STUFF and SOP signals are not sup- 
plied to output facility interfaces 111-1 through 
111-X because they are not needed. It is noted 
that, through this process, in accordance with an 
aspect of the invention, any one of output ports 110 
can address any packet in any one of the RAM 
memories of input ports 104 during the synchro- 
nous polling cycle. Additionally, this feature allows 
a so-called broadcast mode of operation in cross- 
connect 103. That is to say, any number of output 
ports 110 can address the same packet in a par- 
ticular one of input ports 104 during a polling cycle 
and, hence, simultaneously supply that same pack- 
et as an output. Consequently, any problems of 
prior packet transmission and/or switching arrange- 
ments caused by so-called head of the line bloc- 
kage is eliminated. This results in greater through- 
put in cross-connect 103 and, hence, in any net- 
work in which it is employed. Output port status 
unit 717 provides a status indication, i.e., whether 
the output port is functioning properly or not, to 
processor 114 of FIG. 1. 

Operation of output port 110, in accordance 
with aspects of the invention, can best be ex- 
plained by way of examples. Accordingly, FIG. 8 
shows a sequence of timing diagrams (a) through 
(e) illustrating operation of output port 110 for arriv- 
ing statistical, periodic and stuff packets. Thus, 
FIG. 8 (a) shows arrival times for statistical packets 
S1, S2, S3, S4 and S5 and for periodic packets P1, 
P2, P3, P4 and P5. The arrival of the stuff packets 
is not shown because they do not directly affect 
the calculation of the scheduled time of service for 
the statistical packets. It is assumed that upon 
arrival of statistical packet S1 , that transmission has 
just been completed for either a periodic or stuff 



packet, and there are no other packets to be trans- 
mitted and there is no reserved interval for trans- 
mitting periodic packets. Consequently, statistical 
packet S1 is scheduled for service immediately. 

5 This follows from equation (2) since the REAL 
QSUM is zero (0) and the RESQSUM is zero (0) 
and, consequently. TQSUM is zero (0). Therefore, 
the scheduled time of service for packet S1 is time 
T or now, as shown in FIG. 8(b). The REAL QSUM 

w counter 703 is incremented by the WORD COUNT 
of S1 labeled S1, and the RESERVE QSUM coun- 
ter 704 is incremented by (k/1-k)(M + 1) of S1 des- 
ignated (k/1-k)S1, as shown in FIG. 8(c). Upon 
statistical packet S2 arriving, TQSUM is the value 

75 of REAL QSUM, i.e., the total length of packet S1 
less the number of packet words which have been 
transmitted, plus RESQSUM, i.e.. (k/1-k) S1. There- 
fore, from equation (2) STOS for packet S2 is 
T+TQSUM. T is the time at which S2 arrived, and 

20 the REAL QSUM and, hence, TQSUM has been 
decremented by the number of packet words which 
have been transmitted for packet S1, as shown in 
FIG. 8(b). REAL QSUM counter 703 is incremented 
by the WORD COUNT for S2 designated S2, and 

25 the RESERVE QSUM counter 704 is incremented 
by (k/1-k)(M+1) for packet S2, designated (k/1-k)- 
52, also as shown in FIG. 8(b). This procedure is 
followed for statistical packet S3. When periodic 
packet P1 arrives, REAL QSUM counter 703 is 

30 incremented by the WORD COUNT for P1 and the 
RESERVE QSUM counter 704 is decremented by 
the total length of PI. This follows because an 
interval, i.e.. time, has been reserved, in accor- 
dance with an aspect of the invention, for the 

35 transmission of periodic packets and normally the 
net change in TQSUM should be zero (0) regarding 
scheduling a time of service for subsequently arriv- 
ing statistical packets. It is noted, however, that 
when RESQSUM is zero (0), i.e., no time is re- 

40 served for transmission of periodic packets and 
there are no statistical packets to be transmitted, 
the total length of the periodic packet or packets 
determines, in part, the calculated scheduled time 
of service for any arriving statistical packets, see 

45 equations (1) and (2). When statistical packets S4 
and S5 arrive, each respective scheduled time of 
service (STOS) is determined as set forth above. 
The periodic packets P2, P3, P4 and P5 are placed 
in the periodic queue as they arrive, and the appro- 

50 priate incrementing of REAL QSUM counter 703 
and the decrementing of RESERVE QSUM counter 
704 are effected. 

The actual service times for the packets are 
shown in FIG. 8(d), and the actual times of service 

55 and departure of the packets are shown in FIG. 8- 
(e). As indicated above, statistical packet S1 was 
. scheduled for service immediately upon its arrival 
and an interval based on the predetermined rela- 
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tionship to the total length of the Statistical packet 
had been reserved, in accordance with an aspect 
of the invention, to service periodic packets. Thus, 
periodic packet P1 presently in the periodic queue 
is serviced upon completing the transmission of 
statistical packet S1 . Since the transmission of pe- 
riodic packet P1 is completed prior to the occur- 
rence of the STOS for the next statistical packet 
S2, and there are no other periodic packets pres- 
ently in the periodic queue, one or more stuff 
packets (SP) are transmitted. This is important so 
that synchronization is maintained in the network 
and so that information flow is smooth. As noted 
above, continued synchronization requires that 
there are continuous and contiguous packets in the 
network. If there was another periodic packet in the 
periodic queue it would have been serviced imme- 
diately. However, since periodic packet P2 arrives 
prior to the STOS for statistical packet S2 (FIG. 8- 
(b)), it will be serviced upon completing the trans- 
mission of the current stuff packet. Since the stuff 
packets are only one packet word in total length, 
the delay in servicing packet P2 is at most only 
one packet word interval. Since the total length of 
periodic packet P2 is greater than the remainder of 
reserved interval (k/1-k)Sl, the actual time of ser- 
vice of statistical packet S2 is delayed until trans- 
mission of periodic packet P2 is completed, as 
shown in FIG. 8(d) and (e). Upon completion of 
transmission of packet S2, periodic packet P3 is 
serviced. Again, since the transmission of periodic 
packet P3 is completed before the STOS has oc- 
curred for statistical packet S3, stuff packets are 
transmitted until the STOS for packet S3 occurs. 
Upon completing the transmission of statistical 
packet S3, periodic packet P4 is serviced. Since 
the transmission of periodic packet P4 is com- 
pleted prior to the occurrence of STOS for statisti- 
cal S4, and periodic packet P5 is in the periodic 
queue, it will be serviced immediately upon com- 
pleting the transmission of periodic packet P4. Ser- 
vice of statistical packet S4 is delayed until the 
transmission of periodic packet P5 is completed. 
Then, statistical packet S4 is transmitted. There- 
after, stuff packets are transmitted until the occur- 
rence of STOS for statistical packet at which time it 
is transmitted. Thereafter, stuff packets are trans- 
mitted until additional statistical packets and/or pe- 
riodic packets have arrived at the output port. By 
employing this unique multi-queue output schedul- 
ing arrangement, in accordance with aspects of the 
invention, statistical packets are serviced without 
undue delay. Indeed, the longest interval that a 
statistical packet can be delayed from its sched- 
uled time of service is an interval equal to that 
required for the transmission of a maximum length 
periodic packet which, in this example, is 256 
packet words. By employing this unique multi- 



queue strategy, in accordance with an aspect of 
the invention, delaying of periodic packets is mini- 
mized, obtaining accurate information for scheduler 
113 regarding delays encountered by statistical 

5 packets is realized and smoothing is achieved of 
bursty statistical packets streams. 

FIG. 9 shows another sequence of timing dia- 
grams (a) through (e) illustrating operation of output 
port 110 for another sequence of arriving statistical 

10 and periodic packets. FIG. 9(a) again shows arrival 
times for statistical packets S1 , S2. S3, S4 and S5 
and periodic packets P1. P2 and P3. It is again 
assumed that initially the periodic or statistical 
queues are empty and that there is no reserved 

75 interval for transmission of periodic packets. Con- 
sequently, from equations (1) and (2) it is seen that 
statistical packet S1 is serviced immediately, as 
described above regarding FIG. 8. The remaining 
statistical packets S2 through S5 are scheduled for 

20 service in the manner as described above in rela- 
tionship to FIG. 8 and their respective STOS's are 
shown in FIG. 9(b). The corresponding calculated 
time of service showing intervals reserved for 
transmission of periodic and/or stuff packets is 

25 shown in FIG. 9(c). Again, the intervals shown in 
FIG. 9(c) are generated as described above in 
relation to FIG. 8. The actual times of service for 
the packets and departure of the packets is shown 
in FIGS. 9(d) and (e). Thus, as shown in this 

30 example, statistical packet S1 is first transmitted in * 
a manner as described above regarding FIG. 8. 
Upon completing the transmission of packet Si, 
periodic packet P1 is transmitted, in a manner as 
described above regarding FIG. 8. Since periodic 

35 packet P2 is in the periodic queue and the STOS 
for statistical packet S2 has not occurred, it. is 
serviced upon completing transmission of periodic 
packet P1. However, as shown in FIG. 9(d), peri- 
odic packet P2 is large and exceeds all the re- 

40 served intervals RESQSUM for periodic packets in 
RESERVE QSUM counter 704. Consequently, upon 
completing the transmission of periodic packet P2, 
statistical packets S2 through S5 are consecutively 
transmitted. The statistical packets are transmitted 

45 in the manner shown in FIG. 9(d) because their 
corresponding STOS has passed. There is no re- 
served interval RESQSUM for the transmission of 
periodic or stuff packets. The time at which each of 
the statistical packets is to be transmitted is deter- 
so mined in next packet unit 706 in response to time 
T and NSTOS. Specifically, if the STOS for the 
next statistical packet has passed, the correspond- 
ing statistical packet is transmitted upon complet- 
ing the transmission of periodic packet P2. Thus, in 

55 this example, and from FIG. 9. it is seen that the 
STOS's for statistical packets S2 through S3 have 
passed prior to completing the transmission of peri- 
odic packet P2 and that the STOS for statistical 
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packet S4 has passed prior to completing the 
transmission of packet S3. Consequently, packet 
S4 is transmitted upon completing the transmission 
of packet S3. Similarly, the STOS for statistical 
packet S5 passes prior to completing transmission 
of statistical packet S4 and t therefore, statistical 
packet S5 is transmitted immediately upon com- 
pleting the transmission of statistical packet S4. 
Periodic packet P3 is not transmitted until there is 
a reserved interval RESQSUM in RESERVE coun- 
ter 704, or there are no statistical packets to be 
transmitted. Thus, the transmission of periodic 
packet P3 is initiated upon completing the trans- 
mission of statistical packet S5. In this manner, 
statistical packets are assured to be transmitted 
within a reasonable delay interval. Again, it is 
noted, that transmission of a statistical packet will 
be delayed, at most, for an interval required to 
transmit a maximum length periodic packet. How- 
ever, in this example, the statistical and periodic 
packets may encounter unexpected delay intervals 
and, consequently, the desired smoothing is not 
realized. This underscores the importance of ac- 
curately estimating the value of reservation factor k, 
i. e. t the percentage of the available bandwidth 
allocated for transmission of periodic packe.ts. 

FIG. 10 shows details, in simplified block dia- 
gram form, of reservation factor calculator 716 
(FIG.7). Accordingly, word complete signal WC is 
supplied to word counter 1001. Word counter 1001 
generates an output pulse 1 after a predetermined 
number of packet words have been counted which 
denotes a predetermined interval. Type 1 counter 
1002 is reset by the output pulse 1 from word 
counter 1001 and is incremented by signal TYPE 1 
to yield a count of the number of type 1 packet 
words, i.e., periodic packet words, which have been 
transmitted during the predetermined interval. Out- 
put pulse 1 also enables exponentially mapped 
past (EMP) average generator 1004 to update its 
output value k , which is representative of a smooth 
average of the number of periodic packets trans- 
mitted during the predetermined interval. Similarly, 
output pulse 1 enables comparator 1003 to com- 
pare the new EMP average k to the present res- 
ervation factor k and, if there is a difference, to 
adjust up-down counter 1005 accordingly. The out- 
put from up-down counter 1005 is the reservation 
factor k. EMP average generator 1004 generates 
an exponentially mapped past average k' of TYPE 
1 packets which have been transmitted in the last I 
packet words in accordance with: 
k'==W' + (1-W)\ (3) 

where j is a value representative of the proportion 
of periodic packets which have been transmitted at 
the output port during the predetermined interval 
Tl, i.e., the interval needed to transmit I packet 
words, k is the reservation factor and is a value 



representative of the proportion of periodic packets 
expected to be transmitted from the output port 
and W is a weighting factor having a value between 
zero(0) and one(1). The values of the predeter- 

5 mined interval Tl in packet words and weighting 
factor W are dependent on the packet transmission 
rate and the desired averaging time constant, 
namely r = Tl/W. 

FIGs. 11, 12, 13, 14, and 15 when connected 

w A-A, B-B, C-C, D-D, E-E, F-F, G-G, H-H, l-l, J-J, K- 
K, and L-L form a flow diagram illustrating oper- 
ations performed by scheduler 113 (FIG.1). To this 
end, scheduler 113 interfaces with processor 114, 
TBUS, TQBUS and SBUS. TBUS supplies packet 

T5 transport information from input ports 104-1 
through 104-(X + Y) to scheduler 113 on a synchro- 
nous basis. In this example, the synchronous tim- 
ing sequence, i.e., input port polling cycle, includes 
N + 1 time slots and has a timing rate such that 

20 each polling cycle is completed in less than a 
packet word interval of packets being supplied at 
the maximum packet transmission rate for the 
packet network node. It is again noted that 
X + Y = N and that time slot 0 is used to write 

25 certain information into units of input ports 104.. 
The packet transport information obtained by 
scheduler 113 from TBUS is the packet 
destination(DEST), the packet destination extension 
(DEST EXT), the WORD COUNT for the packet, 

30 the last packet transport word OK (IpkTok), type of 
packet (TYPE) and starting address (SAD) in the 
RAM of the corresponding input port. The source 
(SCR), i.e., input port, of the transport information 
is known by the time slot of the polling cycle 

35 during which the transport information was supplied 
to TBUS from the corresponding input port. Pro- 
cessor 114 provides information as to the status of 
the input and output ports and the delay difference 
(DD) between the primary route and secondary 

40 route assigned to each for the packet destination 
(DEST). Port status is obtainable in well known 
fashion by, for example, transmitting test packets 
or simply observing whether or not "good" packets 
are being received. This information is obtained, in 

45 part, from statistics port 116. The delay differences 
are readily obtained by making delay measure- 
ments. The measurements may be obtained by 
employing so-called loop messages to measure the 
round trip delay on routes between packet network 
. so nodes. 

Scheduler 113 also includes a so-called routing 
memory (RAM) which stores information regarding 
possible routes for the packet, i.e., primary or sec- 
ondary, assigned to the packet destination. The 

55 routing RAM also includes the delay difference 
value between the primary and secondary routes. 
Also stored in the routing RAM is information in- 
dicating if the packet has previously been alternate 
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routed, i.e., a so-called rerouted status. FoV certain 
control packets the alternate routed field is em- 
ployed to indicate status of certain of the input 
ports. It is noted that the primary output port as- 
signed to the packet designation may be a so- 
called "real" output port or a so-called "logical" 
output port. In this example, there are N=8 real 
output ports which are designated 1-8. The so- 
called logical output ports are designated 0 and 9- 
15 and are, in this example, as follows: 0-stuff. 9- 
not assigned, 10-conditional source (CSRC). 11- 
conditional extension (CEXT), 12-destination exten- 
sion (DEST EXT), 13-control (CTL), 14-not as- 
signed and 15-stuff. Thus, if a primary output port 
is identified as 1 -through 8 it is a "rear output port, 
i.e., an actual one of output ports 110 in this node 
to which traffic is being directed and if it is iden- 
tified as, for example. 13 it is the one of output 
ports 110 assigned to control. The routing RAM is 
indexed by the DEST field of the packet to yield 
the stored information. 

Additionally, scheduler 113 includes a so-called 
threshold memory unit (RAM) (not shown) which 
stores information regarding possible threshold val- 
ues employed in determining the routes of the 
packets. Specifically, the threshold RAM stores 
threshold values for queuing delay TD, alternate 
routing delay TA and re-routing delay TRR. The 
threshold RAM is indexed by the TYPE field, as 
indicated above, to select predetermined threshold 
values TD, TA, and TRR for the particular packet. 
In this example, the selection of the threshold val- 
ues is based on the type of packet, grade of 
service assigned to the packet and so-called drop- 
pability of the packet. 

Accordingly, the process of scheduler 113 is 
entered via start oval 1101. Thereafter, operational 
block 1102 sets the one of input ports 104 to be 
polled to one (1). Then, conditional branch point 
1 103 tests to determine if the status is good for the 
particular one of input ports 104-1 through 104- 
(X + Y) being polled. If the test result in step 1103 
is NO, the port is not good, i.e., not functioning 
properly, and operational block 1104 causes the 
packet output information to be supplied to statis- 
tics port 116. This is achieved by operational block 

1105 writing the appropriate packet output informa- 
tion on SBUS identifying statistics port 1 1 6 as the 
output port. The packet output information written 
on SBUS typically includes the output port ad- 
dress, the source of the packet (SRC), the starting 
address of the packet in RAM of the corresponding 
input port identified by SRC, the TYPE field and 
WORD COUNT which is the total length (M + 1) of 
the packet. Thereafter, conditional branch point 

1106 tests to determine if input port 104-(X + Y) has 
been polled. If the test result in step 1107 is NO, 
operational block 1106 causes the input port to be 



polled next to be set to the next one. i.e. input 
port = input port+ 1. Then, control is returned to 
step 1103. If the test result in step 1106 is YES, 
the last input port X + Y = N in the polling cycle has 

5 been serviced and operational block 1108 causes 
the polling sequence to wait one (1) time slot. As 
indicated above, this is time slot 0 in the polling 
cycle which is employed to write information into 
several units in each of input ports 104. Thereafter, 

io control is returned to step 1102. Returning to step 
1103, if the test result is YES. the input port being 
polled is good and conditional branch point 1109 
tests to determine if the packet being serviced in 
the particular one of input ports 104 is a new 

75 packet. If the test result in step 1108 is NO, control 
is returned to step 1106 and appropriate ones of 
steps 1102 through 1109 are iterated until step 

1109 yields a YES result. Then, operational block 

1110 causes the new packet transport information 
20 to be obtained from TBUS. Again, it is noted that 

the routing RAM is indexed by the DEST field to 
yield the stored information regarding the primary 
and secondary routes and, hence, the primary and 
secondary output ports assigned to the packet des- 

25 ti nation, the delay difference between the routes 
and the rerouting status or if the output port is a 
logical output port an indication of appropriate ones 
of input ports 104 designated for a particular con- 
trol function. Similarly, the threshold RAM is in- 

30 dexed by the TYPE field to yield values for thresh- 
olds TD, TA and TRR. Thereafter, conditional 
branch point 1111 tests to determine if the packet 
is good or if it is a stuff packet. If lpkTok = 1, the 
packet is good. If the primary output port for the 

35 packet is identified as 0 or 15 from the routing 
RAM the packet is a stuff packet. If the test result 
in step 1111 is NO, the packet is either not good, 
i.e., lpkTok = 0, or a stuff packet and operational 
block 1104 causes the appropriate packet output 

40 information to be supplied to statistics port 116 via 
step 1105 and SBUS. Thereafter, control is re- 
turned to step 1106 and appropriate ones of steps 
1102 through 1111 are repeated until step 1111 
yields a YES result. If the test resurt in step 1111 is 

45 YES, the packet is good and operational block 
1112 obtains the primary and secondary routes 
assigned to the packet destination (DEST), the 
delay difference (DD) between the primary and 
secondary routes, threshold values TD, TA and 

so TRR and re-routing status for the packet, i.e., 
whether the packet was previously alternate routed 
or not. It is noted that typically the primary route 
has less fixed transmission delay than the secon- 
dary route, however, there may be instances that 

55 the delays are substantially equal. Operational 
block 1113 obtains from TQBUS the queuing delay 
at the ones of output ports 110 assigned to the 
primary and secondary routes, namely. TQSUM (P) 
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and TQSUM (5), respectively, and the interval re- 
served for the transmission of periodic packets, 
namely, RESQSUM (P) and RESQSUM (S), re- 
spectively. The status, i.e, good or bad, for the 
primary and secondary output ports, namely, status 5 
(P) and status (S), respectively, assigned to the 
packet destination is obtained from processor 114. 

Conditional branch point 1114 tests to deter- 
mine if the primary output port for the packet is the 
one of output ports 110 designated the control port. io 
This is obtained from the routing RAM. Specifically, 
in this example, if the primary output port is des- 
ignated 13, it is the designated control output port. 
If the test result in step 1114 is YES, conditional 
branch point 1115 (FIG. 13) tests to determine 75 
whether the status of the output port designated 
control (CTL) is good. If the test result in step 1115 
is NO, control is returned to step 1104 and appro- 
priate ones of the steps of the process are re- 
peated until either step 1114 yields a NO result or 20 
step 1115 yields a YES result If step 1115 yields a 
YES result, conditional branch point 1116 tests to 
determine if the queuing delay, i.e., number of 
packet words waiting to be transmitted, at the con- 
trol output port exceeds a predetermined threshold 25 
value, namely, whether 
TQSUM(CTL)) > TD, (4) 

where the value TD is set so that if the packet is 
going to experience more than an acceptable value 
of queuing delay, its transmission is terminated at 30 
statistics port 116. For example, the value of 
threshold TD is set such that if the packet will be 
overwritten in the RAM in the corresponding one of 
input ports 104 prior to being transmitted from the 
assigned output port the packet transmission is 35 
essentially terminated. Thus, if the test result in 
step 1116 is YES, control is returned to step 1104 
and the statistics port is designated the output port. 
Step 1105 (FIG. 15) causes the appropriate packet 
output information to be written to SBUS which, in 40 
turn, supplies it to statistics port 116. Thereafter, 
control is returned to step 1106 (FIG. 11). If the test 
result in step 1116 is NO, operational block 1117 
designates the output port to be the one of output 
ports 110 assigned to be the control (CTL) output 45 
port. Step 1105 causes appropriate packet output 
information to be supplied to the control output port 
via SBUS. Thereafter, control is returned to step 
1106 and appropriate steps of the process are 
iterated. 50 

Returning to step 1114 (FIG. 12), if the test 
result is NO, the primary output port is not control 
and conditional branch point 1118 tests to deter- 
mine if the primary output port is identified as the 
output port assigned to the source (SRC) of the 55 
packet, namely, the conditional source (CSRC). 
This designation essentially loops the packet back 
to its source. To this end, conditional branch point 
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1119 tests to determine if the conditional source 
(CSRC) is intended to have this packet routed to it. 
This is realized by evaluating the routing status 
field to determine if the input port (SRC) which 
supplied the packet is approved for this function. If 
the test result in step 1119 is NO, appropriate ones 
of steps 1 1 15-1 1 17 are repeated to determine if the 
output port is the control output port or the statis- 
tics output port. If the test result in step 1119 is 
YES, conditional branch point 1120 tests to deter- 
mine the status of the output port OPSRC assigned 
to the particular input port (SRC). If the test result 
in step 1120 is YES, the status (OPSRC) is good 
and conditional branch point tests to determine if 
the queuing delay at the output port (OPSRC) 
exceeds a predetermined threshold, namely, 
whether 

TQSUM(OPSRC) > TD. (5) 
The value of and conditions set for threshold TD 
are essentially the same as that used in equation 
(4). If the test result in step 1121 is YES, the 
queuing delay is too long and step 1104 (FIG. 11) 
causes the output port to be statistics port 116. 
Step 1105 causes the appropriate packet output 
information to be written on SBUS which, in turn, 
supplies it to statistics port 116. The packet output 
information written on SBUS typically includes the 
output port address, the source of the packet 
(SRC), the starting address (SAD) of the packet in 
the RAM of the corresponding input port identified 
by SRC, the TYPE field and WORD COUNT. Upon 
completion of step 1105, control is returned to step 
1106 (FIG. 11). If the test result in step 1121 is NO, 
the queuing delay at the output port assigned to 
OPSRC is satisfactory and operational block 1122 
selects the output port to be the one assigned to 
the particular SRC, i.e., OPSRC. Thereafter, step 
1105 writes the packet output information on SBUS 
which, in turn, supplies it to the output port as- 
signed to OPSRC. It is important to note that this 
process involves so-called indirect addressing in 
order to determine which one of output ports 1 1 0 is 
assigned to the particular one of input ports 104 
which is interfaced to the particular signal source 
(SRC). This is important because a remote node 
from which the signal may be transmitted has no 
information as to such output port assignments in 
this particular node. The use of the rndirect ad- 
dressing is important for achieving loop transmis- 
sions and the like to establish nearest node 
(neighbor) tables and the like. 

Returning to step 1118 (FIG. 12), if the test 
result is NO, the primary output port is not CSRC 
and conditional branch point 1123 tests to deter- 
mine if the primary output port assigned to DEST 
of the packet is an output port assigned to a so- 
called conditional extension (CEXT). This is another 
use of indirect addressing in which it is being 
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determined if the packet is from CEXT, it is sent to 
the control output port and if the packet is from the 
control input, it is sent to the output port assigned 
to conditional extension (CEXT), i.e., to DEST EXT. 
Thus, if the test result in step 1123 is YES, con- 
ditional branch point 1124 tests to determine if the 
input port is assigned to control (CTL). If the test 
result in step 1124 is NO, the output port is not 
DEST EXT and control is returned to step 1115. 
Steps 1115-1117 are repeated to determine if the 
output port assigned to control (CTL) is good or 
whether the packet is to be supplied to statistics 
port 116, as described above. If the test result in 
step 1124 is YES, conditional branch point 1125 
tests to determine if the output port assigned to 
DEST EXT is "real", i.e., one of the N (N = 1-8) 
actual output ports in this node. If the test result in 
step 1125 is NO, control is returned to step 1104 
(FIG. 11> and the packet is supplied to statistics 
port 116, as described above. If the test result in 
step 1125 is YES, the associated output port is 
DEST EXT and conditional branch point 1126 tests 
its status. If the test result in step 1126 is NO, the 
status (DEST EXT) is not . good and control is 
returned to step 1104 (FIG. 11) and the packet is 
supplied to statistics port 116, as described above. 
If the test result in step 1126 is YES, status (DEST 
EXT) is good and conditional branch point 1 1 27 
tests to determine if the queuing delay at the 
output port assigned to DEST EXT exceeds a 
predetermined threshold, namely, whether 
TQSUM(DEST EXT)= > TD. (6) 
The same conditions apply to TD as described 
above regarding equation (4). If the test result in 
step 1127 is YES, the queuing delay is too long 
and control is returned to step 1104 (FIG. 11) and 
the packet is supplied to statistics port 116, as 
described above. If the test result in step 1127 is 
NO, the queuing delay is below the threshold TD 
and operational block 1128 selects the output port 
to be DEST EXT, as identified in bit positions 
VCID(16)-VCID(19) in the packet transport word. 
Thereafter, step 1105 (FIG. 15) writes the packet 
output information on SBUS which, in turn, supplies 
it to the appropriate output port assigned to DEST 
EXT. Then, control is returned to step 1106. Again, 
the packet output information written on SBUS typi- 
cally includes the output port address, the source 
of the packet (SRC), the starting address (SAD) of 
the packet in RAM of the corresponding input port 
identified by SRC, the TYPE field and WORD 
COUNT which is total length (M + 1) of the packet. 

Returning to step 1123 (FIG. 12), if the test 
result is NO. the primary output port is not CEXT 
and conditional branch point 1129 tests to deter- 
mine if the primary output port is DEST EXT. If the 
test result in step 1129 is YES. conditional branch 
point 1130 tests to determine if the output port 



assigned to DEST EXT is control (CTL). Again, this 
is another example of indirect addressing. If the 
test result in step 1130 is YES, the output port is 
assigned to control and the process returns to step 

5 1115. Appropriate ones of steps 1115-1117 are 
repeated, as described above, to determine if the 
packet is supplied to either the control output port 
or statistics port 116. Returning to step 1130, if the 
test result is NO, the output port assigned to DEST 

70 EXT is not control and conditional branch point 
1131 (FIG. 13) tests to determine if the output port 
assigned to DEST EXT is assigned to conditional 
source (CSRC). Again, this is another example of 
indirect addressing which is used to locate appro- 

is priate output ports in this node for packets trans- 
mitted from a remote node that does not know the 
port assignments in this node, if the test result in 
step 1131 is NO, the output port assigned to DEST 
EXT is not CSRC, control is returned to step 1125 

20 and appropriate ones of steps 1125-1128 are re- 
peated to determine if the packet is to be supplied 
to the output port assigned to DEST EXT or to 
statistics port 116, as described above. If the test 
result in step 1131 is YES, appropriate ones of 

25 steps 1 1 1 9-1 1 22 and 1115-1117 are repeated to 
determine if the packet is to be supplied to the 
output port assigned to the conditional source, i.e, 
OPSRC, to the control (CTL) output port or to 
statistics port 116, as described above. 

30 Returning to step 1129. if the test result is NO, 

the primary output port is not DEST EXT and 
conditional branch point 1132 (FIG. 14) tests to 
determine if the primary output port is "real", i.e.. 
one of the N (N = 1-8) actual output ports in this 

35 node. If the test result in step 1 1 32 is NO, control 
is returned to step 1104 and the packet is supplied 
to statistics port 116, as described above. If the 
test result in step 1132 is YES, the primary output 
port is real and conditional branch port 1133 tests 

40 the status of the one of output ports 110 assigned 
to the primary route, i.e., status (P). If the primary 
output port status is not good, the test result in 
step 1133 is NO and conditional branch point 1134 
tests the status of the output port assigned to the 

as secondary route, i.e., status (S). If the test result in 
step 1134 is NO, control is returned to step 1104 
(FIG. 11) and the packet is supplied to statistics 
port 116, as described above. If the test result in 
step 1134 is YES, conditional branch point 1135 

so tests to determine if the queuing delay, i.e., num- 
ber of packet words to be transmitted from the 
secondary output port, exceeds a predetermined 
delay threshold TD, namely, whether 
TQSUM (S) > TD . (7) 

55 Again, the value of TD is set so that if the packet is 
going to experience more than an acceptable 
amount of delay in being transmitted, its transmis- 
sion is terminated at statistics port 116. For exam- 
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pie, the value of delay threshold TD is set such 
that, if the packet will be overwritten in the RAM in 
the corresponding one of input ports 104 prior to 
being transmitted from the output port its transmis- 
sion is terminated. Consequently, delay threshold 
TD has a relatively high value. Thus, if the test 
result in step 1134 is YES, control is returned to 
step 1104 (FIG. 11) and the packet is supplied to 
statistics port 116. as described above. If the test 
result in step 1135 is NO, the delay is acceptable 
and conditional branch point 1136 tests to deter- 
mine if the packet has been previously alternate 
routed. This is readily determined from the destina- 
tion of the packet (DEST), which input port (SRC) 
that the packet was received on and the known 
system topology. Again, it is important to not al- 
ternate route and, if necessary, to terminate trans- 
mission of packets that have been previously al- 
ternate routed if they will experience too long a 
delay in transmission. Termination of transmission 
of such packets minimizes the likelihood that the 
so-called "funeral effect"can result. As is known, 
the "funeral effect" causes throughput in the sys- 
tem to become increasingly less as the load on the 
system increases. Therefore, terminating transmis- 
sion of packets that have been previously alternate 
routed when the delay in the secondary output port 
exceeds a predetermined minimum acceptable re- 
routing threshold TRR increases overall system 
"good" throughput. Thus, if "the test result in step 

1136 is NO, the packet has not been previously 
alternate routed and step 1137 selects the secon- 
dary output port to transmit the packet. Step 1105 
writes the packet output information to SBUS and, 
then, control is returned to step 1106 (FIG. 11). if 
the test result in step 1136 is YES, the packet has 
been previously alternate routed and conditional 
branch point 1138 tests to determine if the queuing 
delay TQSUM(S) at the secondary output port is 
greater than the predetermined re-routing threshold 
TRR, namely, whether 

TQSUM (S) > TRR (8) 

It is noted that threshold TRR represents some 
minimal transmission delay interval at the secon- 
dary output port so that if the packet were supplied 
to the secondary output port it would experience 
only a minimal delay before being transmitted. 
Thus, if the test result in step 1138 is YES, the 
delay is too long, control is returned to step 1104 
(FIG. 11) and the packet is supplied to statistics 
port 116, as described above. If the test result in 
step 1138 is NO, the delay is acceptable and step 

1137 selects the secondary output port for trans- 
mitting the packet. Thereafter, step 1105 causes 
the packet output information to be written on 
SBUS and, then, control is returned to step 1106 
(FIG. 11). 

Returning to step 1133 (FIG. 14), if the primary 



output port status (P) is good, a YES result is 
obtained and conditional branch point 1139 tests to 
determine whether the queuing delay at the pri- 
mary output port exceeds the delay threshold TD, 
5 namely, whether 

TQSUM (P) > TD. (9) 

Again, the conditions regarding TD are as de- 
scribed above. If the test result in step 1139 is 
YES.* control is transferred to conditional branch 

io point 1141. If the test result in step 1139 is NO, 
-control is transferred to conditional branch point 
"1140 (FIG. 15). 

Conditional branch point 1141 (FIG. 14) tests to 
determine whether the packet is a so-called type 1, 

75 i.e., periodic packet This is achieved by determin- 
ing if bit position TYPE (1) includes a logical 1. If 
so, this packet is periodic. This test is important 
because it is not desirable to terminate transmis- 
sion of periodic packets. If the test result in step 

20 1141 is NO, the packet is statistical and appro- 
priate ones of steps 1134-1138 and 1104 are per- 
formed, as described above. If the test result in 
step 1141 is YES, the packet is periodical and 
conditional branch point 1142 tests to determine if 

25 the primary output port assigned to the packet 
DEST has a reserved interval for the transmission 
of periodic packets, namely, whether 
RESQSUM (P)> 0. (10) 

If the test result in step 1142 is YES, operational 
30 block 1143 (FIG. 15) selects the primary output 
port to transmit the packet. Thereafter, operational 
block 1105 causes the packet output information, 
as described above, to be written on the SBUS 
and, then, control is returned to step 1106 (FIG. 
35 11). 

If the test result in step 1142 is NO, conditional 
branch point 1144 tests the status of the secondary 
output port assigned to the packet DEST, namely, 
status(s). If the test result in step 1144 is NO, the 

40 status (S) is not good, control is returned to step 
1104 (FIG. 11) and the packet is supplied to statis- 
tics port 116, as described above. If the test result 
in step 1144 is YES. the status <S) is good and 
conditional branch point 1145 tests to determine if 

45 the packet is a minimum delay type. This test is 
achieved by interrogating bit position TYPE (4) to 
determine whether or not it is a logical 1. A logical 
1 indicates that the packet has a minimum delay 
class of service assinged to it. It is noted that both 

so periodic and statistical packets can be assigned a 
class of service requiring minimum delay. If the 
test result in step 1145 is NO, the packet(FIG. 11) 
is not a minimum delay type, control is returned to 
step 1104, and the packet is supplied to statistics 

55 port 116, as described above. If the test result in 
step 1145 is YES, the packet is a minimum delay 
type and conditional branch point 1146 tests to 
determine if the secondary output port assigned to 
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the packet DEST has a reserved interval for the 
transmission of periodic packets, namely, whether 
RESQSUM (S) > 0. (11) 

If the test result in step 1146 is YES, there is an 
interval reserved for transmitting periodic packets, 
control is returned to step 1136 (FIG. 15) and 
appropriate ones of steps 1136-1138 (FIG. 19) and 

1104 (FIG. 11) are repeated to determine if the 
secondary output port is to be selected to transmit 
the packet or whether the packet is supplied to 
statistics port 116, as described above. In turn, 
step 1105 causes the packet output information, as 
described above, to be written on the SBUS. 
Thereafter, control is returned to step 1106 (FIG. 
1 1 ). If the test result in step 1 146 is NO, there is no 
interval reserved for transmitting periodic packets, 
control is returned to step 1135 and appropriate 
ones of steps 1135-1138 and 1104 are repeated to 
determine whether the secondary output Dort is 
selected to transmit the packet or whether the 
packet is supplied to statistics port 116. as de- 
scribed above. In turn, step 1105 causes the pack- 
et output information to be written on SBUS. Then, 
control is returned to step 1106 (FIG. 11). 

Conditional branch point 1140 (FIG. 15) also 
tests to determine if the packet is a type 1, i.e., 
periodic packet, as described above, if the test 
result in step 1140 is YES, the packet is periodic 
and conditional branch point 1147 tests to deter- 
mine if the primary output port assigned to the 
packet DEST has a reserved interval for the trans- 
mission of periodic packets, in accordance with 
equation (10). If the test result in step 1 147 is YES, 
step 1143 selects the assigned primary output port 
to transmit the packet, step 1105 writes the packet 
output information to SBUS, as described above, 
and control is returned to step 1106 (FIG. 11). If the 
test result in step 1147 is NO, conditional branch 
point 1148 tests to determine if the packet is a 
minimum delay type, as described above. If the 
test result in step 1148 is NO, steps 1143 and 1105 
are effected, as described above, and control is 
returned to step 1106 (FIG. 11). If the test result in 
step 1148 is YES. conditional branch point 1149 
tests the status of the secondary output port as- 
signed to the packet DEST, namely, status (5). If 
the test result in step 1149 is NO, steps 1143 and 

1105 are effected, as described above, and control 
is returned to step 1106 (FIG. 11). If the test result 
in step 1149 is YES. conditional branch point 1150 
tests to determine if the secondary output port 
assigned to the packet DEST has a reserved inter- 
val for the transmission of periodic packets in ac- 
cordance with equation (11). If the test result in 
step 1150 is YES, step 1137 selects the secondary 
output port to transmit the packet, step 1 105 writes 
the packet output information to SBUS and control 
is returned to step 1106 (FIG. 11). This follows 
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because the secondary output port will have jthe 
least delay in transmitting the packet. If the test 
result in step 1150 is NO. conditional branch point 
1151 tests to determine which one of the primary 

5 and secondary output ports has less delay, in ac- 
cordance with an aspect of the invention, by com- 
paring the actual queuing delay, i.e., amount of 
packet information to be transmitted, at each of the 
primary and secondary output ports relative to a 

w predetermined threshold TA and the delay differ- 
ence DD between the primary and secondary 
routes assigned to the packet DEST. The relation- 
ship is whether 

TQSUM (P) - TQSUM (S) > TA + DD. (12) 

75 The value of threshold TA is selected to be a value 
significantly lower than the delay threshold TD and 
such that the packet is not unnecessarily routed to 
the secondary route. This minimizes the possibility 
of the so-called "funeral effect" resulting. Again, 

20 the "funeral effect" is a condition that results in 
lower and lower network throughput because of 
packets being alternate routed. Consequently, as 
network loading increases system "good" through- 
put decreases. If the test result in step 1151 is NO, 

25 the primary output port has the least delay, step 
1143 selects the primary output port to transmit the 
packet, step 1 1 05 writes the packet output informa- 
tion to SBUS and control is returned to step 1106 
(FIG. 11). If the test result in step 1151 is YES, the 

30 secondary output port has the least delay, control 
is returned to step 1136 and appropriate ones of 
steps 1136-1138 and 1104 are repeated to deter- 
mine whether the secondary output port is selected 
to transmit the packet or whether the packet is to 

35 be supplied to statistics port 116, as described 
above. Thereafter, control is returned to step 1106 
(FIG. 11). 

Returning to step 11 40, if the test result is NO, 
the packet is statistical and conditional branch point 

40 1152 tests to determine if the packet is a minimum 
delay type, in a manner as described above. If the 
test result in step 1152 is NO, the packet is not a 
minimum delay type, step 1143 selects the primary 
output port to transmit the packet. Thereafter, step 

45 1105 writes the packet output information to SBUS 
and control is again returned to step 1106 (FIG. 
11). If the test result in step 1152 is YES, the 
statistical packet has been assigned a minimum 
delay grade of service and conditional branch point 

so 1153 tests the secondary output port status, i.e., 
status (S). If the test result in step 1153 is NO, the 
status (S) is not good and step 1143 selects the 
primary output port to transmit the packet. This 
follows because the secondary output port is not 

55 available and. hence, the primary route will have 
the least delay. Again, step 1105 writes the packet 
output information to SBUS and, thereafter, control 
is returned to step 1106. If the test result in step 

20 
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1153 is YES, conditional branch point 1154 tests to 
determine which one of the primary and secondary 
output ■ ports has less delay in accordance with 
equation (12) f described above. If the test result in 
step 1154 is NO, the primary output port has less 
delay and step 1143 selects it to transmit the 
packet. Again, step 1105 writes the packet output 
information to SBUS and, thereafter, control is re- 
turned to step 1106. If the test result in step 1154 
is YES, the secondary output port has less delay, 
control is transferred to step 1136 and appropriate 
ones of steps 1136-1138 and 1104 are repeated to 
determine whether the secondary output port is 
selected to transmit the packet or whether the 
packet is to be supplied to statistics port 116, as 
described above. Thereafter, step 1105 writes the 
packet output information to SBUS and control is 
then returned to step 1 1 06. 



OUTPUT LOCAL PACKET INTERFACE 

Output local packet interfaces 112-1 through 
112-Y (FIG. 1) are employed to interface output 
ports 110-(X+1) through 110-(X + Y), respectively, 
to particular apparatus and/or communications links 
as desired via output terminals 115-(X + 1) through 
115-(X + Y),respectively. As indicated above, the 
apparatus and/or communications links being inter- 
faced, correspond to those interfaced by input local 
packet interfaces 106 in packetizers 105-1 through 
105-Y. This follows because there is a need for two 
way communication between the apparatus and/or 
communication links being interfaced. To this end, 
each of output ports 110-(X + 1) through 110-(X + Y) 
supplies the packet information a byte at a time 
along with a start of packet (SOP) signal and a 
STUFF signal to an associated one of output local 
packet interfaces 112. Each of output local packet 
interfaces 112 supplies an ENABLE OUT signal to 
its associated one of output ports 110. The EN- 
ABLE OUT signal is at a packet byte rate and 
indicates to the associated output port that the 
output local packet interface is ready to receive a 
packet byte. Each of output, local packet interfaces 
112 includes apparatus for depackettzing the sup- 
plied packets and for supplying the depacketized 
information in an appropriate signal format for the 
apparatus and/or communications link being inter- 
faced. The SOP signal indicates the beginning of 
the packet so that it can be properly depacketized. 
The STUFF signal indicates whether the packet 
could be ignored. Apparatus to be included in 
individual ones of output local packet interfaces 
112 will depend on the particular apparatus or 
communication link being interfaced and will be 
apparent to those skilled in the art. 



NETWORK 

FIG. 16 depicts a network, in simplified form, 
which advantageously utilizes aspects of the inven- 

5 tion. It is noted that there is two way communica- 
tion between elements forming the network. Ac- 
cordingly, shown are private networks 1601 and 
1602, so-called local networks 1603 and 1604 and 
higher layer network 1605. Although only two iay- 

10 ers in the public system hierarchy are shown, it will 
be apparent to those skilled in the art that any 
number of layers may be employed as needed or 
desired in the overall network. Each of private 
networks 1601 and 1602 may include a number of 

75 switching and access packet network nodes includ- 
ing aspects of the invention. For example, private 
networks 1601 and 1602 may be those of a particu- 
lar transport network user and be located at diverse 
geographic locations. The broadband packets gen- 

20 erated in the private networks are identical to those 
described in relation to packet network node 100 
and employed in networks used in the public sys- 
tem. A particular private network is assigned a 
unique reference code word Xref in order to iden- 

25 tify its packets and to provide transparency for all 
other information being transmitted. The broadband 
packets supplied to and from private network 1601 
and another apparatus and/or communication links 
are supplied to an access packet network node 

30 (AN) 1606. In turn, access node 1608 supplies 
packets to and receives packets from a switching 
packet network node (SN) in local network 1603. 
As indicated above, the packets from private net- 
work 1601 and signals from other interfacing ap- 

35 paratus appear as information and are formatted 
into broadband packets by a packetizer in access 
node 1606. These broadband packets are gen- 
erated using a unique reference code word Xref 
assigned to local network 1603. The packets in 

40 local network 1603 may traverse several switching 
nodes (SN) or be supplied to some other appara- 
tus, network or transmission facility interfacing local 
network 1603 via access node 1606 or some other 
access node (not shown). If the packets are des- 

45 tined for some , other local network, for example, 
network 1604, they will be supplied via gateway 
node 1607 to higher layer network 1605 and, there- 
in, to a switching node (SN). In gateway node 
1607, a new transport word is appended to each 

so packet which has been generated using a unique 
reference code word assigned to higher layer net- 
work 1605. This appending can be achieved by 
simply adding another transport word to the pack- 
ets or* by stripping off the previous transport word 

55 and adding a new one generated in gateway node 
1607. Similarly, if packets are being supplied from 
higher layer network 1605 to local network 1603, 
gateway node 1607 would strip the higher layer 
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network transport word which had been added or if 
the transport word was replaced dropping the high- 
er layer network transport word and adding a trans- 
port word generated with the reference code word 
Xref assigned to local network 1603. If the packets 
being transmitted in higher layer network 1605 are 
destined for local network 1604, they are supplied 
thereto via gateway node 1608. Gateway node 
1608 performs the same functions as gateway 
node 1607. In local network 1604, the packets are 
supplied via one or more switching nodes to ac- 
cess node 1609. Access node 1609 supplies the 
packets to a specific apparatus, transmission fa- 
cility or private network 1602. Again, the packets 
destined for private network 1602 include transport 
words generated by using a unique reference code 
word Xref assigned to the private network transport 
user. Consequently, the packets will be recognized 
in private network 1602. Therefore, it is seen that 
the private network packets can be readily iden- 
tified by use of the unique reference code word 
and still transmit the private network packets on a 
transparent basis through the broadband packet 
network hierarchy. 



Claims 

1. A packet switch comprising: 
a plurality of input ports; 

means for supplying incoming packets to said input 
ports; 

a plurality of output ports, each adapted for sup- 
plying packet information as an output; 
means for interfacing said output ports to output 
media; 

CHARACTERIZED IN THAT 

each of said plurality of input ports includes means 
for supplying as an output packet transport in- 
formation for individual packets being stored in said 
input ports; 

each of said plurality of output ports includes 
means for generating a first representation of delay 
in supplying a packet as an output by said output 
port; and 

scheduler means responsive to said packet trans- 
port information from one of said plurality of input 
ports for a particular packet and to one or more of 
said first representations of delay from said plural- 
ity of output ports for scheduling said particular 
packet to be supplied as an output by one or more 
of said plurality of output ports. 

2. The packet switch as defined in claim 1 
wherein said scheduler means includes means re- 
sponsive to said transport information for obtaining 
an identification of an assigned at least first output 
port and an assigned at least second output port 
for said particular packet, means for obtaining a 



predetermined first threshold value assigned to 
said particular packet, first comparison means for 
comparing a first representation of delay from sard 
assigned at least first output port to said first 

5 threshold value and for supplying as a first output a 
result of said comparing and first determination 
means responsive to said first output for determin- 
ing whether said particular packet should be sup- 
plied as an output by said assigned at least first 

10 output port, supplied as an output by said assigned 
at least second output port or discarded. 

3. The packet switch as defined in claim 2 
wherein said transport information includes at least 
a packet type indication , said packet type indica- 
te tion indicating at least whether said particular pack- 
et is a first type packet or a second type packet, 
wherein each of said plurality of output ports fur- 
ther includes means for generating a second repre- 
sentation of intervals reserved for supplying as an 

20 output packets of said first type, and wherein said 
first determination means is further responsive to a 
second representation from said assigned at least 
first output port and to said packet type indication 
for determining whether said particular packet 

25 should be supplied as an output by said assigned 
at least first output port, supplied as an output by 
said assigned at least second output port or dis- 
carded. 

4. The packet switch as defined in claim 3 
30 wherein sard first determination means is further 

responsive to a second representation from said 
assigned at least second output port for determin- 
ing whether said particular packet should be sup- 
plied as an output by said assigned at least second 
35 output port or discarded. 

5. The packet switch as defined in claim 4 
wherein said first determination means includes 
second comparison means for comparing said first 
representation of delay from said assigned at least 

40 second output port to said at least first threshold 
value and for supplying as a second output a result 
of said comparing and second determination 
means responsive to said second output for deter- 
mining whether said particular packet should be 

4s supplied as an output by said assigned at teast 
second output port or discarded. 

6. The packet switch as defined in claim 5 
wherein said second determination means includes 
third determination means for determining whether 

50 said particular packet has previously been alternate 
routed and for generating as a third output an 
indication of whether said particular packet has 
been previously alternate routed and fourth deter- 
mination means responsive to said third output for 

55 determining whether said packet should be sup- 
plied as an output by said assigned at least second 
output port or discarded. 

7. The packet switch as defined in claim 6 
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wherein said scheduler means further includes 
means for obtaining a predetermined second 
threshold value assigned to said particular packet, 
wherein said fourth determination means includes 
third comparison means for comparing said first 
representation of delay from said assigned at least 
second output port to said second threshold value 
and for generating as a fourth output the result of 
said comparing and means responsive to said 
fourth output for selecting said at least second 
output port for supplying said particular packet as 
an output or discarding said particular packet. 

8. The packet switch as defined in claim 7 
wherein said first threshold value is greater in value 
than said second threshold value. 

9. The packet switch as defined in claim 2 
wherein each of said plurality of output ports fur- 
ther includes means for generating an output port 
status indication indicating whether said output port 
is operative or not and wherein said first determina- 
tion means is further responsive to a status indica- 
tion from said assigned at least first output port and 
a status indication from said assigned at least 
second output port for determining whether said 
particular packet should be supplied as an output 
by said assigned at least first output port, supplied 
as an output by said assigned at least second 
output port or discarded. 

10. The packet switch as defined in claim 9 
wherein said type indication for said particular 
packet further includes a grade of service indica- 
tion for said particular packet and wherein said first 
determination means is further responsive to said 
grade of service indication for determining whether 
said particular packet should be supplied as an 
output by said assigned at least first output port, 
supplied as an output by said assigned at least 
second output port or discarded. 

11. The packet switch as defined in claim 10 
wherein said first type packet is a periodic packet, 
said second type packet is a statistical type packet 
and said grade of service is a minimum delay 
grade of service. 

12. The packet switch as defined in claim 3 
wherein said first determination means is further 
responsive to a second representation from said 
assigned at least second output port for determin- 
ing whether said particular packet should be sup- 
plied as an output by said assigned at least first 
output port, as an output by said assigned at least 
second output port or discarded. 

13. The packet switch as defined in claim 12 
wherein said scheduler means further includes 
means for obtaining a predetermined third thresh- 
old value assigned to said particular packet and a 
delay difference value between a first transmission 
route and a second transmission route assigned to 
a destination for said particular packet and means 



for utilizing said first representation of delay from 
said assigned at least first output port, said first 
representation of delay from said assigned at least 
second output port, said third threshold value and 

5 said delay difference value to determine if said 
particular packet should be supplied as an output 
by said assigned at least first output port, supplied 
as an output by said assigned at least second 
output port or discarded. 

io 14. The packet switch as defined in claim 13 

wherein said first determination means includes 
second determination means for determining 
whether said particular packet has previously been 
alternate routed and for generating as a second 

75 output an indication of whether said particular pack- 
et has been previously alternate routed and third 
determination means responsive to said second 
output for determining whether said packet should 
be supplied as an output by said assigned at least 

20 second output port or discarded. 

15. The packet switch as defined in claim 14 
wherein said scheduler means further includes 
means for obtaining a predetermined second 
threshold value assigned to said particular packet, 

25 wherein said third determination means includes 
second comparison means for comparing said first 
representation of delay from said assigned at least 
second output port to said second threshold value 
and for generating as a third output the result of 

30 said comparing and means responsive to said third 
output for selecting said at least second output port 
for supplying said particular packet as an output or 
discarding said particular packet. 

16. The packet switch as defined in claim 15 
35 wherein said first threshold value is greater in value 

than said second threshold value and said third 
threshold value is greater in value than said second 
threshold value. 

17. The packet switch as defined in claim 13 
40 wherein each of said plurality of output ports fur- 
ther includes means for generating an output port 
status indication indicating whether said output port 
is operative or not and wherein said first determina- 
tion means is further responsive to a status indica- 

45 tion from said assigned at least first output port and 
a status indication from said assigned at least 
second output port for determining whether said 
particular packet should be supplied as an output 
by said assigned at least first output port, supplied 

so as an output by said assigned at least second 
output port or discarded. 

18. The packet switch as defined in claim 17 
wherein said type indication for said particular 
packet further includes a grade of service indica- 

55 tion for said particular packet and wherein said first 
determination means is further responsive to said 
grade of service indication for determining whether 
said particular packet should be supplied as an 
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output by said assigned at least first output port, 
supplied as an output by said assigned at least 
second output port or discarded. 

19. The packet switch as defined in claim 18 
wherein said first type packet is a periodic packet, 5 
said second type packet is a statistical packet and 
said grade of service is a minimum delay grade of 
service. 

20. The packet switch as defined in claim 2 
wherein said transport information includes at least 10 
a packet type indication, said packet type indica- 
tion indicating at least whether said particular pack- 
et is a first type packet or a second type packet, 

and wherein said first determination means is fur- 
ther responsive to said packet type indication for 75 
determining whether said particular packet should 
be supplied as an output by said assigned at least 
first output port, supplied as an output by said 
assigned at least second output port or discarded. 

21. The packet switch as defined in claim 20 20 
wherein said type indication for said particular 
packet further includes a grade of service indica- 
tion for said particular packet and wherein said first 
determination means is further responsive to said 
grade of service indication for determining whether 25 
said particular packet should be supplied as an 
output by said assigned at least first output port, 
supplied as an output by said assigned at least 
second output port or discarded. 

22. The packet switch as defined in claim 21 30 
wherein each of said plurality of output ports fur- 
ther includes means for generating an output port 
status indication indicating whether said output port 

is operative or not and wherein said first determina- 
tion means is further responsive to a status indica- 35 
tion from said assigned at least first output port and 
a status indication from said assigned at least 
second output port for determining whether said 
particular packet should be supplied as an output 
by said assigned at least first output port, supplied ao 
as an output by said assigned at least second 
output port or discarded. 

23. The packet switch as defined in claim 22 
wherein said scheduler means further includes 
means for obtaining a predetermined third thresh- 45 
old value assigned to said particular packet and a 
delay difference value between a first transmission 
route and a second transmission route assigned to 

a destination for said particular packet and means 
for utilizing said first representation of delay from so 
said assigned at least first output port, a first repre- 
sentation of delay from said assigned at least sec- 
ond output port, said third threshold value and said 
delay difference value to determine if said particu- 
lar packet should be supplied as an output by said 55 
assigned at least first output port, supplied as an 
output by said assigned at least second output port 
or discarded. 



24. The packet switch as defined in claim 23 
wherein said first determination means includes 
second determination means for determining 
whether said particular packet has previously been 
alternate routed and for generating as a second 
output an indication of whether said particular pack- 
et has been previously alternate routed and third 
determination means responsive to said second 
output for determining whether said packet should 
be supplied as an output by said assigned at least 
second output port or discarded. 

25. The packet switch as defined in claim 24 
wherein said scheduler means further includes 
means for obtaining a predetermined second 
threshold value assigned to said particular packet, 
wherein said third determination means includes 
second comparison means for comparing said first 
representation of delay from said assigned at least 
second output port to said second threshold value 
and for generating as a third output the result of 
said comparing and means responsive to said third 
output for selecting said at least second output port 
for supplying said particular packet as an output or 
discarding said particular packet. 

26. The packet switch as defined in claim 25 
wherein said first type packet is a periodic packet, 
said second type packet is a statistical type packet 
and said grade of service is a minimum delay 
grade of service. 

27. The packet switch as defined in claim 26 
wherein said first threshold value is greater in value 
than said second threshold value and said third 
threshold value is greater than said second thresh- 
old value. 

28. The packet switch as defined in claim 1 
wherein said scheduler means further includes 
means responsive to said transport information for 
obtaining an output port designation for a particular 
packet, and wherein said scheduler means includes 
means responsive to said output port designation 
and to a first representation of delay from an output 
port associated with said designation for determin- 
ing if said particular packet is to be supplied as an 
output by said output port associated with said 
designation or an alternate one of said output ports . 
determined in accordance with prescribed criteria. 

29. The packet switch as defined in claim 28 
wherein said prescribed criteria in based on in- 
direct addressing of said particular packet in rela- 
tionship to assignments made to particular ones of 
said output ports in the packet switch. 
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